00000001:02000400:0.0F:1788650879.918573:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788650898.339755:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788650900.080521:0:3229:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 611 MB/s 00000001:01000000:3.0F:1788650900.333167:0:3229:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 620 MB/s 00000001:01000000:0.0:1788650900.583242:0:3229:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4639 MB/s 00000020:02000000:0.0:1788650901.264070:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_ge0d621e 00000400:02000000:2.0:1788650902.222627:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.121@tcp [8/256/0/180] 00008000:02000000:2.0:1788650905.725029:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788650949.189537:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1788650957.032193:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788650957.032209:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788650957.033577:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008afd44b9 00000080:02000400:2.0:1788650957.033593:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788650957.040633:0:5822:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788650957.040646:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788650957.040683:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000035117fa3) 00000020:00000080:2.0:1788650957.040701:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788650957.073970:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788650957.074954:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788650957.107095:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788650957.107156:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788650957.107177:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788650957.107226:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788650957.107251:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788650957.109398:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788650957.109407:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788650957.109415:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887976ef7 00000020:01000004:2.0:1788650957.109422:0:5822:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788650957.109426:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788650957.109430:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008afd44b9 from MGS 00000020:01000004:2.0:1788650957.109433:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788650957.109441:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000766602bd) 00000020:00000080:2.0:1788650957.109450:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788650957.109918:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008afd44b9 from MGS, refs=2 00080000:01000000:2.0:1788650957.109924:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788650957.109929:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887976f05 00000100:00100000:2.0:1788650957.110033:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788650957.110667:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788650957.110674:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788650957.114293:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788650957.114308:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788650957.120083:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788650957.120321:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788650957.120328:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788650957.124214:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788650957.124317:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788650957.125416:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788650957.125424:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788650957.126337:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650957.126340:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650957.126342:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650957.126636:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650957.126638:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650957.126640:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650957.132337:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788650957.133357:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788650957.383092:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3123 MB/s 00000001:01000000:3.0:1788650957.632254:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6155 MB/s 00000001:01000000:3.0:1788650957.882336:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1107 MB/s 00000001:01000000:3.0:1788650958.132784:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1275 MB/s 00080000:10000000:3.0:1788650958.142568:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1788650958.155217:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788650958.171078:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788650958.171556:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788650958.171560:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788650958.172358:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788650958.172434:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788650958.172484:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788650958.172708:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788650958.172732:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788650958.173090:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788650958.173339:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788650958.173346:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788650958.174291:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788650958.174303:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788650958.175024:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788650958.175031:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788650958.183755:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788650958.183779:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.121@tcp' 00000020:01000004:3.0:1788650958.183782:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788650958.183844:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.121@tcp (typ=mgc) 00000020:00000080:3.0:1788650958.183864:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.121@tcp (000000007b095153) 00000020:00000080:3.0:1788650958.183882:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788650958.184507:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007b6ec36d@MGC192.168.203.121@tcp: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1788650958.184703:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.121@tcp-0 is initialized 00000040:01000000:3.0:1788650958.184710:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788650958.184958:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788650958.185637:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788650958.185679:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.121@tcp (uuid be0363c2-36c6-418a-b340-2685dfcc42ae) 00000020:00000080:0.0:1788650958.185701:0:5822:0:(genops.c:1385:class_connect()) connect: client be0363c2-36c6-418a-b340-2685dfcc42ae, cookie 0x84a2fba887976f13 00000100:00080000:0.0:1788650958.185713:0:5822:0:(import.c:545:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788650958.185720:0:5822:0:(import.c:665:import_select_connection()) MGC192.168.203.121@tcp: import 000000007b6ec36d using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1788650958.185760:0:5822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000edbc1273 x1875536408215680/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788650958.185791:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import be0363c2-36c6-418a-b340-2685dfcc42ae->MGS 00000020:01000004:0.0:1788650958.185807:0:5822:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788650958.185812:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788650958.185830:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006e6dcb2f) 00000020:00000080:0.0:1788650958.185840:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788650958.187193:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edbc1273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be0363c2-36c6-418a-b340-2685dfcc42ae:3305:1875536408215680:0@lo:250: 00000100:00100000:3.0:1788650958.187281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650958.187362:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408215680 00000100:00100000:3.0:1788650958.187370:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408215680 00000100:00100000:3.0:1788650958.187400:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788650958.187405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e5b10ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875536408215680:12345-0@lo:250: 00010000:00080000:3.0:1788650958.187442:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from be0363c2-36c6-418a-b340-2685dfcc42ae@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1788650958.187464:0:5833:0:(genops.c:1385:class_connect()) connect: client be0363c2-36c6-418a-b340-2685dfcc42ae, cookie 0x84a2fba887976f21 00000100:00080000:3.0:1788650958.187579:0:5833:0:(import.c:65:import_set_state_nolock()) 0000000042b8653c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788650958.187625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e5b10ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:3305:x1875536408215680:12345-0@lo:250: Request processed in 218us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650958.187632:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788650958.187671:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788650958.187679:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1788650958.187685:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788650958.187689:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788650958.187692:0:3305:0:(import.c:65:import_set_state_nolock()) 000000007b6ec36d MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788650958.187695:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788650958.187698:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788650958.187702:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edbc1273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be0363c2-36c6-418a-b340-2685dfcc42ae:3305:1875536408215680:0@lo:250: 00000100:00100000:0.0:1788650958.205388:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788650958.205578:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788650958.205583:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788650958.216321:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788650958.216425:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788650958.217001:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788650958.217010:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788650958.217896:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788650958.218083:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788650958.218089:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788650958.218801:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788650958.218808:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788650958.267589:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788650958.267827:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788650958.267834:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788650958.271414:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788650958.271428:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788650958.272485:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788650958.272684:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788650958.272691:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788650958.273487:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788650958.273495:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788650958.274010:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788650958.274408:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788650958.274413:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788650958.275597:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788650958.275607:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788650958.276529:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788650958.276694:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788650958.276699:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788650958.277754:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788650958.277786:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788650958.333712:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788650958.333919:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788650958.333925:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788650958.336445:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788650958.336460:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788650958.338734:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788650958.338750:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788650958.339785:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788650958.339807:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788650958.339812:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788650958.339933:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788650958.340062:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788650958.340066:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788650958.340068:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788650958.340069:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650958.340070:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650958.340071:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650958.340072:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650958.340074:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788650958.340075:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788650958.340076:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650958.340077:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650958.340079:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650958.340080:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788650958.340082:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788650958.340085:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788650958.340086:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788650958.340087:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650958.340092:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650958.340093:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650958.340094:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650958.340095:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788650958.340096:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788650958.340097:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650958.340097:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650958.340098:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650958.340099:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788650958.340387:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788650958.340404:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9491a4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408215808:0@lo:253: 00000100:00100000:2.0:1788650958.340493:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650958.340614:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000027058a51 going to sleep for 11 seconds 00000100:00100000:3.0:1788650958.341333:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408215808 00000100:00100000:3.0:1788650958.341342:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408215808 00000100:00100000:3.0:1788650958.341417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788650958.341425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1f0b406 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5822:x1875536408215808:12345-0@lo:253: 20000000:01000000:3.0:1788650958.341471:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788650958.341473:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788650958.346304:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788650958.347361:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788650958.347694:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788650958.349720:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788650958.349936:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788650958.349940:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788650958.349946:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788650958.349948:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788650958.349975:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788650958.350390:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788650958.350917:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788650958.350931:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788650958.351731:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788650958.351796:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788650958.351827:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788650958.351928:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788650958.351937:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788650958.352029:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788650958.352037:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788650958.352067:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788650958.352073:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788650958.352096:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788650958.352174:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788650958.353679:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788650958.353688:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788650958.353704:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788650958.353926:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788650958.353944:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788650958.354011:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788650958.354047:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788650958.354091:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788650958.354102:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788650958.355648:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788650958.355664:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788650958.355728:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788650958.356583:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788650958.356627:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788650958.356642:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788650958.356800:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788650958.356812:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788650958.356848:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788650958.356887:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788650958.357081:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788650958.357179:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788650958.358436:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788650958.360536:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788650958.361577:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788650958.361606:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.121@tcp for mdt 20000000:01000000:1.0:1788650958.361609:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:1.0:1788650958.361667:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788650958.361676:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788650958.361708:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788650958.361716:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:1.0:1788650958.361762:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788650958.361772:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788650958.361800:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788650958.361829:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788650958.361887:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788650958.361890:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788650958.361894:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788650958.361922:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788650958.361924:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788650958.361951:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788650958.361953:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788650958.363496:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788650958.366079:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788650958.366235:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788650958.366273:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788650958.366288:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788650958.366291:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788650958.369959:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788650958.381577:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788650958.381627:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788650958.381702:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788650958.381720:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788650958.381722:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788650958.381727:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788650958.381729:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788650958.381734:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788650958.381739:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788650958.382439:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788650958.382564:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788650958.401575:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788650958.401623:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788650958.401716:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788650958.402830:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788650958.402854:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402871:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402881:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402888:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402895:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402902:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402907:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007dc68d1a already unused, calling callback (000000006fa6c9fc) 00010000:00010000:1.0:1788650958.402911:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402917:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402938:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402945:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650958.402952:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007dc68d1a/0x84a2fba887976f28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788650958.402969:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788650958.641955:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1f0b406 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5822:x1875536408215808:12345-0@lo:253: Request processed in 300523us (301454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650958.641985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788650958.642376:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9491a4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408215808:0@lo:253: 10000000:01000000:3.0:1788650958.642394:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788650958.642397:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788650958.642399:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788650958.642414:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788650958.642415:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788650958.642417:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788650958.642418:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788650958.642419:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788650958.642421:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788650958.642422:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788650958.642423:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788650958.642425:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788650958.642445:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008afd44b9 from lustre-MDT0000 10000000:01000000:3.0:1788650958.642469:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788650958.642472:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788650958.642476:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93be45690000 10000000:01000000:3.0:1788650958.642480:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788650958.642487:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93be45690000 from 1 10000000:01000000:3.0:1788650958.642490:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788650958.642538:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.642548:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.642557:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650958.642574:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408215936:0@lo:101: 00000100:00100000:3.0:1788650958.642611:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650958.642716:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408215936 00000100:00100000:2.0:1788650958.642722:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408215936 00000100:00100000:2.0:1788650958.642756:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788650958.642775:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041558867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5822:x1875536408215936:12345-0@lo:101: 00010000:00010000:2.0:1788650958.642786:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650958.642802:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011ae2ac3/0x84a2fba887976f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976f2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650958.642822:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011ae2ac3/0x84a2fba887976f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976f2f expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650958.642831:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011ae2ac3/0x84a2fba887976f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f2f expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650958.642845:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011ae2ac3, rc 0) 00000100:00100000:2.0:1788650958.642872:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041558867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+6:5822:x1875536408215936:12345-0@lo:101: Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650958.642877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788650958.643018:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020d75a44 going to sleep for 11 seconds 00000100:00100000:3.0:1788650958.643032:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408215936:0@lo:101: 00010000:00010000:3.0:1788650958.643048:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.643055:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650958.643140:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216064:0@lo:501: 00000100:00100000:3.0:1788650958.643392:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650958.643511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216064 00000100:00100000:2.0:1788650958.643516:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216064 00000100:00100000:2.0:1788650958.643549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788650958.643555:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081c0c236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+6:5822:x1875536408216064:12345-0@lo:501: 00000100:00100000:2.0:1788650958.643757:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081c0c236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+6:5822:x1875536408216064:12345-0@lo:501: Request processed in 202us (365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788650958.643776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788650958.643968:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020d75a44 going to sleep for 11 seconds 00000100:00100000:3.0:1788650958.643992:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216064:0@lo:501: 10000000:01000000:3.0:1788650958.644077:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788650958.644337:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.644346:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000006eabfe2f/0x84a2fba887976f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650958.644355:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93be4384a800 10000000:01000000:3.0:1788650958.644361:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788650958.644365:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93be4384a800 10000000:01000000:3.0:1788650958.644368:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788650958.644370:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93be4384a800 from 1 10000000:01000000:3.0:1788650958.644373:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788650958.644397:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.644405:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.644413:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650958.644427:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216192:0@lo:101: 00000100:00100000:3.0:1788650958.644469:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650958.644577:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020d75a44 going to sleep for 11 seconds 00000100:00100000:2.0:1788650958.644659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216192 00000100:00100000:2.0:1788650958.644664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216192 00000100:00100000:2.0:1788650958.644729:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788650958.644736:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000847496f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+6:5822:x1875536408216192:12345-0@lo:101: 00010000:00010000:2.0:1788650958.644746:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650958.644757:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069efab96/0x84a2fba887976f44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976f3d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650958.644844:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069efab96/0x84a2fba887976f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976f3d expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650958.644853:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069efab96/0x84a2fba887976f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f3d expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650958.644861:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069efab96, rc 0) 00000100:00100000:2.0:1788650958.644898:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000847496f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+7:5822:x1875536408216192:12345-0@lo:101: Request processed in 162us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650958.644910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788650958.644986:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216192:0@lo:101: 00010000:00010000:3.0:1788650958.645008:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.645016:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650958.645027:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788650958.645041:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.645046:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000d3cb2472/0x84a2fba887976f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650958.645052:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788650958.645055:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788650958.645059:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93be4384a800 10000000:01000000:3.0:1788650958.645062:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788650958.645065:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788650958.645067:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788650958.645079:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.645085:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.645091:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650958.645139:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216320:0@lo:101: 00000100:00100000:3.0:1788650958.645174:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650958.645562:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020d75a44 going to sleep for 11 seconds 00000100:00100000:0.0:1788650958.645632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216320 00000100:00100000:0.0:1788650958.645637:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216320 00000100:00100000:0.0:1788650958.645663:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788650958.645669:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006224942a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+7:5822:x1875536408216320:12345-0@lo:101: 00010000:00010000:0.0:1788650958.645678:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650958.645687:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000abcb5fc3/0x84a2fba887976f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976f4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650958.645700:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abcb5fc3/0x84a2fba887976f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976f4b expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650958.645708:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000abcb5fc3/0x84a2fba887976f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f4b expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650958.645714:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000abcb5fc3, rc 0) 00000100:00100000:0.0:1788650958.645751:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006224942a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+8:5822:x1875536408216320:12345-0@lo:101: Request processed in 82us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650958.645757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788650958.645893:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216320:0@lo:101: 00010000:00010000:3.0:1788650958.645905:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650958.645912:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650958.645959:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216448:0@lo:501: 00000100:00100000:3.0:1788650958.645993:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650958.646018:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020d75a44 going to sleep for 11 seconds 00000100:00100000:0.0:1788650958.646135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216448 00000100:00100000:0.0:1788650958.646139:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216448 00000100:00100000:0.0:1788650958.646356:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788650958.646362:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099e380c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+8:5822:x1875536408216448:12345-0@lo:501: 00000100:00100000:0.0:1788650958.646590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099e380c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5822:x1875536408216448:12345-0@lo:501: Request processed in 227us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650958.646596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788650958.646671:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216448:0@lo:501: 00000100:00100000:3.0:1788650958.646701:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216576:0@lo:503: 00000100:00100000:3.0:1788650958.646736:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650958.646762:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020d75a44 going to sleep for 11 seconds 00000100:00100000:0.0:1788650958.646936:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216576 00000100:00100000:0.0:1788650958.646941:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216576 00000100:00100000:0.0:1788650958.646965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788650958.646971:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcecaef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5822:x1875536408216576:12345-0@lo:503: 00000100:00100000:0.0:1788650958.647387:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcecaef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5822:x1875536408216576:12345-0@lo:503: Request processed in 415us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650958.647394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788650958.647483:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216576:0@lo:503: 00000100:00100000:2.0:1788650958.647957:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000237ee6e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5864:1875536408216704:0@lo:502: 00000100:00100000:2.0:1788650958.648075:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650958.648466:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028b0a365 going to sleep for 11 seconds 00000100:00100000:1.0:1788650958.648525:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216704 00000100:00100000:1.0:1788650958.648532:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216704 00000100:00100000:1.0:1788650958.648621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788650958.648629:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f436671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5864:x1875536408216704:12345-0@lo:502: 00000100:00100000:1.0:1788650958.648860:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f436671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5864:x1875536408216704:12345-0@lo:502: Request processed in 232us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650958.648866:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788650958.648944:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000237ee6e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5864:1875536408216704:0@lo:502: 00000020:01000000:3.0:1788650958.648969:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788650958.648990:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650958.648993:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788650958.649007:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788650958.649011:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788650958.649029:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000dab3a2cf) 00000020:00000080:3.0:1788650958.649045:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788650958.649050:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788650958.649418:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788650958.649425:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887976f60 00000020:00000080:3.0:1788650958.649669:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788650958.649674:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788650958.649678:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650958.649680:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788650958.649682:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788650958.649686:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650958.649687:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788650958.649691:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788650958.649698:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000cd831b3) 00000020:00000080:3.0:1788650958.649707:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788650958.649712:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788650958.649713:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788650958.649716:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788650958.649723:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788650958.649778:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008afd44b9 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788650958.649791:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ef5f6e72) 00000020:00000080:3.0:1788650958.649798:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788650958.649858:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788650958.649865:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba887976f75 00000020:00000080:3.0:1788650958.649947:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788650958.649953:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788650958.649956:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x84a2fba887976f7c 00080000:01000000:3.0:1788650958.649962:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788650958.649965:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887976f83 00080000:10000000:3.0:1788650958.650846:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788650958.651381:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788650958.657921:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788650958.751741:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788650958.752052:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788650958.755935:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788650958.756375:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788650958.788235:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000092ca2850) 00000020:00000080:3.0:1788650958.788256:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788650958.788340:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788650958.788348:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887976f91 00000020:00000080:1.0:1788650958.788950:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788650958.790723:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788650958.830681:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788650958.856421:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788650958.920093:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788650958.965633:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650959.012946:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788650959.035831:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x84a2fba887976f98 00000020:00000080:1.0:1788650959.036390:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788650959.036401:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650959.036408:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650959.036410:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788650959.036413:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788650959.036416:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650959.036417:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788650959.036421:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788650959.036422:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788650959.036431:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650959.036434:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650959.036435:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788650959.036437:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788650959.036442:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650959.036443:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788650959.036447:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788650959.036485:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788650959.036556:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081882fae pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5864:1875536408216832:0@lo:502: 00000100:00100000:1.0:1788650959.036636:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650959.036700:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c996f50 going to sleep for 11 seconds 00000100:00100000:3.0:1788650959.037477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216832 00000100:00100000:3.0:1788650959.037487:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216832 00000100:00100000:3.0:1788650959.037533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788650959.037541:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c5c1c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5864:x1875536408216832:12345-0@lo:502: 00000100:00100000:3.0:1788650959.039650:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c5c1c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5864:x1875536408216832:12345-0@lo:502: Request processed in 2104us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650959.039663:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788650959.040331:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081882fae pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5864:1875536408216832:0@lo:502: 00000020:01000000:1.0:1788650959.040372:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650959.040380:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650959.040382:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788650959.040386:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788650959.040671:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788650959.040693:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788650959.040710:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.040721:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 0000000099779a3a/0x84a2fba887976f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650959.040729:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be4384a800 from 1 10000000:01000000:3.0:1788650959.040732:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788650959.040771:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.040779:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.040797:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650959.040815:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216960:0@lo:101: 00000100:00100000:3.0:1788650959.040856:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.040898:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650959.041424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408216960 00000100:00100000:0.0:1788650959.041431:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408216960 00000100:00100000:0.0:1788650959.041509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788650959.041517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fea8898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+9:5822:x1875536408216960:12345-0@lo:101: 00010000:00010000:0.0:1788650959.041529:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650959.041542:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976f9f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.041563:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976f9f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.041572:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f9f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.041581:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bc423c7, rc 0) 00000100:00100000:0.0:1788650959.041638:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fea8898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+10:5822:x1875536408216960:12345-0@lo:101: Request processed in 122us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650959.041645:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788650959.041716:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408216960:0@lo:101: 00010000:00010000:3.0:1788650959.041733:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.041741:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650959.042328:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217088:0@lo:256: 00000100:00100000:3.0:1788650959.042366:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.043209:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650959.043326:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217088 00000100:00100000:1.0:1788650959.043334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217088 00000100:00100000:1.0:1788650959.043369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788650959.043375:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000855b7ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+10:5822:x1875536408217088:12345-0@lo:256: 20000000:01000000:1.0:1788650959.043392:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788650959.043397:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788650959.043484:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000855b7ae8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+10:5822:x1875536408217088:12345-0@lo:256: Request processed in 109us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650959.043491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788650959.043569:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217088:0@lo:256: 10000000:01000000:3.0:1788650959.044101:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788650959.044138:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.044147:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650959.044155:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be4384a800 from 1 10000000:01000000:3.0:1788650959.044157:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788650959.044189:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.044197:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.044205:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650959.044220:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217216:0@lo:101: 00000100:00100000:3.0:1788650959.044509:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.044536:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650959.044582:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217216 00000100:00100000:1.0:1788650959.044595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217216 00000100:00100000:1.0:1788650959.044617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788650959.044622:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da5726d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+10:5822:x1875536408217216:12345-0@lo:101: 00010000:00010000:1.0:1788650959.044639:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788650959.044650:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976fad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650959.044666:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976fad expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650959.044674:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976fad expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650959.044682:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000052cc97, rc 0) 00000100:00100000:1.0:1788650959.044714:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da5726d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408217216:12345-0@lo:101: Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650959.044720:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788650959.044865:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217216:0@lo:101: 00010000:00010000:3.0:1788650959.044882:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.044889:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650959.044950:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217344:0@lo:501: 00000100:00100000:3.0:1788650959.044984:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.045003:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650959.045097:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217344 00000100:00100000:1.0:1788650959.045102:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217344 00000100:00100000:1.0:1788650959.045147:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788650959.045151:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ecc68e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408217344:12345-0@lo:501: 00000100:00100000:1.0:1788650959.045927:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ecc68e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408217344:12345-0@lo:501: Request processed in 773us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650959.046194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788650959.047305:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217344:0@lo:501: 00000100:00100000:3.0:1788650959.047357:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217472:0@lo:503: 00000100:00100000:3.0:1788650959.047417:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.047450:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650959.047582:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217472 00000100:00100000:1.0:1788650959.047597:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217472 00000100:00100000:1.0:1788650959.047632:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788650959.047640:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac9fd9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408217472:12345-0@lo:503: 00000040:00080000:1.0:1788650959.047682:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788650959.047726:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac9fd9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408217472:12345-0@lo:503: Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650959.047743:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788650959.048583:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217472:0@lo:503: 00000040:00080000:1.0:1788650959.050006:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788650959.050428:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788650959.050468:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788650959.050523:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.050535:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650959.050578:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788650959.050581:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93be4384a800 10000000:01000000:3.0:1788650959.050584:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93be4384a800 10000000:01000000:3.0:1788650959.050588:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788650959.050604:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be4384a800 from 1 10000000:01000000:3.0:1788650959.050607:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788650959.050637:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.050645:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.050654:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650959.050673:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217600:0@lo:101: 00000100:00100000:3.0:1788650959.050729:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.050777:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650959.050840:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217600 00000100:00100000:0.0:1788650959.050858:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217600 00000100:00100000:0.0:1788650959.050910:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788650959.050918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fdc9237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408217600:12345-0@lo:101: 00010000:00010000:0.0:1788650959.051352:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650959.051365:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a5bf61f/0x84a2fba887976fc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976fbb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.051385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a5bf61f/0x84a2fba887976fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976fbb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.051395:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a5bf61f/0x84a2fba887976fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976fbb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.051402:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a5bf61f, rc 0) 00000100:00100000:0.0:1788650959.051440:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fdc9237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5822:x1875536408217600:12345-0@lo:101: Request processed in 523us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650959.051446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788650959.051606:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217600:0@lo:101: 00010000:00010000:3.0:1788650959.051622:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.051629:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650959.051685:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217728:0@lo:501: 00000100:00100000:3.0:1788650959.051712:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.051742:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650959.052355:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217728 00000100:00100000:0.0:1788650959.052361:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217728 00000100:00100000:0.0:1788650959.052399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788650959.052406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e3b8b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5822:x1875536408217728:12345-0@lo:501: 00000100:00100000:0.0:1788650959.052622:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e3b8b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5822:x1875536408217728:12345-0@lo:501: Request processed in 217us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650959.052630:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788650959.052701:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217728:0@lo:501: 00000100:00100000:3.0:1788650959.052735:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217856:0@lo:503: 00000100:00100000:3.0:1788650959.052779:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.052803:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cda25ed0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650959.052923:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217856 00000100:00100000:0.0:1788650959.052927:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217856 00000100:00100000:0.0:1788650959.052958:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788650959.052963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd50c02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5822:x1875536408217856:12345-0@lo:503: 00000100:00100000:0.0:1788650959.053419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd50c02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5822:x1875536408217856:12345-0@lo:503: Request processed in 456us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650959.053426:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788650959.053501:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9a3cd38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408217856:0@lo:503: 00000100:00100000:0.0:1788650959.053776:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b48265ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5869:1875536408217984:0@lo:502: 00000100:00100000:0.0:1788650959.053808:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650959.054097:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd240c76 going to sleep for 11 seconds 00000100:00100000:3.0:1788650959.054462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408217984 00000100:00100000:3.0:1788650959.054468:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408217984 00000100:00100000:3.0:1788650959.054533:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788650959.054540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3f84a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5869:x1875536408217984:12345-0@lo:502: 00000100:00100000:3.0:1788650959.054860:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3f84a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5869:x1875536408217984:12345-0@lo:502: Request processed in 320us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650959.054868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788650959.055097:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b48265ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5869:1875536408217984:0@lo:502: 00000020:01000004:1.0:1788650959.055169:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788650959.055191:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c00d400b) 00000020:00000080:1.0:1788650959.055208:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788650959.055310:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008afd44b9 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788650959.055314:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008afd44b9 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788650959.055316:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008afd44b9 4 00010000:00080000:1.0:1788650959.055339:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000de101aef@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1788650959.058683:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788650959.059145:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788650959.059181:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788650959.059194:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x84a2fba887976fd0 00000100:00080000:1.0:1788650959.059203:0:5869:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788650959.059207:0:5869:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000de101aef using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788650959.059313:0:5869:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000081882fae x1875536408218112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788650959.059340:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788650959.060071:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002330eafe pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5869:1875536408218240:0@lo:502: 00000100:00100000:1.0:1788650959.060168:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650959.060201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218240 00000100:00100000:1.0:1788650959.060208:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218240 00000100:00100000:1.0:1788650959.060372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788650959.060382:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045540569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5869:x1875536408218240:12345-0@lo:502: 00000100:00100000:1.0:1788650959.060671:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045540569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5869:x1875536408218240:12345-0@lo:502: Request processed in 290us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650959.060685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788650959.060739:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b83f492a going to sleep for 11 seconds 00000100:00100000:3.0:1788650959.060855:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081882fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408218112:0@lo:38: 00000100:00100000:3.0:1788650959.060891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650959.061007:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002330eafe pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:5869:1875536408218240:0@lo:502: 00000040:00080000:1.0:1788650959.061033:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788650959.061150:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218112 00000100:00100000:2.0:1788650959.061158:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218112 00000100:00100000:2.0:1788650959.061186:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650959.061192:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9a3cd38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875536408218112:12345-0@lo:38: 00000100:00100000:1.0:1788650959.061196:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788650959.061204:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788650959.061244:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9a3cd38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875536408218112:12345-0@lo:38: Request processed in 51us (352us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788650959.061251:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650959.061280:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788650959.061286:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000de101aef lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788650959.061290:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788650959.061293:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081882fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408218112:0@lo:38: 00000020:01000000:3.0:1788650959.061345:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788650959.061364:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788650959.063576:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650959.063591:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000ed09987e/0x84a2fba887976fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788650959.063662:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788650959.063666:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788650959.063667:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788650959.063669:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788650959.063670:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788650959.063672:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788650959.063672:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788650959.063674:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788650959.063675:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788650959.063676:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788650959.063678:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788650959.063680:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788650959.063683:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788650959.063686:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788650959.063688:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788650959.063690:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788650959.063691:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788650959.063692:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788650959.063693:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788650959.063694:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788650959.063696:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788650959.063697:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788650959.063698:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788650959.063700:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788650959.063701:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788650959.063726:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788650959.063742:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fbe1d3a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408218368:0@lo:253: 00000100:00100000:3.0:1788650959.063808:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650959.063846:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4d2c7eb going to sleep for 11 seconds 00000100:00100000:2.0:1788650959.065215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218368 00000100:00100000:2.0:1788650959.065227:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218368 00000100:00100000:3.0:1788650959.065324:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788650959.065334:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071f96cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5822:x1875536408218368:12345-0@lo:253: 20000000:01000000:3.0:1788650959.065384:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788650959.065398:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788650959.110610:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788650959.110633:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788650959.110749:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788650959.110754:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788650959.110774:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.110793:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f9f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.110800:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.110836:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976f9f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.110851:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976f9f expref: 12 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650959.110865:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca62b05d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875536408218496:0@lo:104: 00000100:00100000:0.0:1788650959.110926:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650959.111008:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e635aaf going to sleep for 11 seconds 00000100:00100000:2.0:1788650959.111146:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218496 00000100:00100000:2.0:1788650959.111155:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218496 00000100:00100000:2.0:1788650959.111200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650959.111209:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b40aea53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5857:x1875536408218496:12345-0@lo:104: 00010000:00010000:2.0:1788650959.111222:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111431:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788650959.111459:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b40aea53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5857:x1875536408218496:12345-0@lo:104: Request processed in 252us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650959.111467:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788650959.111496:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788650959.111501:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111509:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b276634 already unused, calling callback (000000004a30fc29) 10000000:00010000:2.0:1788650959.111512:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111520:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788650959.111526:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788650959.111531:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788650959.111560:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111566:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788650959.111582:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111588:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: 000000006b276634/0x84a2fba887976f9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fa6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111616:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788650959.111618:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788650959.111619:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788650959.111710:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408218624:0@lo:103: 00000100:00100000:2.0:1788650959.111741:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650959.111805:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218624 00000100:00100000:2.0:1788650959.111809:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218624 00010000:00010000:2.0:1788650959.111823:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976f9f expref: 13 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650959.111841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650959.111846:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5ba325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3307:x1875536408218624:12345-0@lo:103: 00010000:00010000:2.0:1788650959.111855:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788650959.111859:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976f9f expref: 13 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111867:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976f9f expref: 13 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111879:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111886:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788650959.111899:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001145438s 00010000:00010000:2.0:1788650959.111902:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111907:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111912:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.111928:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.112012:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d216087 already unused, calling callback (000000006fa6c9fc) 00010000:00010000:2.0:1788650959.112015:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.112022:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.112029:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650959.112038:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788650959.112071:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5ba325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3307:x1875536408218624:12345-0@lo:103: Request processed in 225us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650959.112077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650959.112123:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408218624:0@lo:103: 00010000:00010000:0.0:1788650959.113711:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008bc423c7/0x84a2fba887976fa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976f9f expref: 12 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650959.113728:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca62b05d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875536408218496:0@lo:104: 00010000:00010000:0.0:1788650959.113744:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.113752:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.113827:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650959.113833:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d216087/0x84a2fba887976fd7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650959.133731:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071f96cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5822:x1875536408218368:12345-0@lo:253: Request processed in 68387us (69911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650959.133745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788650959.135192:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fbe1d3a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:5822:1875536408218368:0@lo:253: 10000000:01000000:3.0:1788650959.135225:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788650959.135227:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788650959.135229:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788650959.135230:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788650959.135231:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788650959.135233:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788650959.135234:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788650959.135235:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788650959.135236:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788650959.135237:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788650959.135238:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788650959.135239:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788650959.135240:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788650959.135254:0:5822:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788650959.147790:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788650959.148872:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788650959.152089:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788650959.152404:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788650959.152680:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788650959.152829:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788650959.153539:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788650959.153782:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788650959.153968:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788650959.154180:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788650959.154406:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788650959.154574:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1788650959.175663:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1788650959.198617:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788650959.240058:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788650959.240154:0:5875:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788650959.240159:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788650959.240388:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788650959.248910:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788650959.252009:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788650959.252464:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788650959.252474:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788650959.252622:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788650959.255665:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788650959.263319:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788650959.263431:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788650959.263651:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788650959.264220:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788650959.266033:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788650959.266437:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788650959.266594:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788650959.266725:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788650959.267139:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788650959.267300:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788650959.267465:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788650959.267606:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788650959.268004:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788650959.268212:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788650959.268364:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788650959.268519:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788650959.268693:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788650959.269103:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788650959.269441:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788650959.269574:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788650959.270268:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788650959.270403:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788650959.270534:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788650959.270660:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788650959.270874:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788650959.271226:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788650959.271374:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788650959.271498:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788650959.271642:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788650959.271928:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788650959.272189:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788650959.272343:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788650959.272487:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788650959.272634:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788650959.274374:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788650959.274591:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788650959.275023:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788650959.294304:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788650959.370751:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788650959.370778:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb91e0191f988 00100000:10000000:0.0:1788650959.370785:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788650959.374477:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788650959.374502:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788650959.374521:0:5822:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788650959.374546:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788650959.379325:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788650959.379388:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788650959.379392:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788650960.198288:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650961.221576:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650962.244615:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650963.276668:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788650964.292733:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788650964.359956:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788650964.359964:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be4384a800 from 3 10000000:01000000:2.0:1788650964.359969:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788650964.360012:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.360025:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.360035:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650964.360057:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408218752:0@lo:101: 00000100:00100000:2.0:1788650964.360138:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650964.360179:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0ee64e3 going to sleep for 11 seconds 00000100:00080000:2.0:1788650964.360195:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788650964.360200:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788650964.360203:0:38:0:(import.c:65:import_set_state_nolock()) 00000000de101aef lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788650964.360211:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000de101aef using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1788650964.360231:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ec24cc3f x1875536408218880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788650964.360264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218752 00000100:00100000:2.0:1788650964.360280:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218752 00000100:00100000:2.0:1788650964.360324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788650964.360332:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a63e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5838:x1875536408218752:12345-0@lo:101: 00010000:00010000:2.0:1788650964.360344:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650964.360354:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ceb915f/0x84a2fba887976fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976fde expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.360375:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ceb915f/0x84a2fba887976fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976fde expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.360384:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ceb915f/0x84a2fba887976fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976fde expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.360392:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ceb915f, rc 0) 00000100:00100000:2.0:1788650964.360426:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a63e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408218752:12345-0@lo:101: Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650964.360432:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788650964.360461:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec24cc3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408218880:0@lo:38: 00000100:00100000:2.0:1788650964.360526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650964.360561:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408218880 00000100:00100000:2.0:1788650964.360565:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408218880 00000100:00100000:2.0:1788650964.360583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788650964.360587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cb91866 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875536408218880:12345-0@lo:38: 00010000:00080000:2.0:1788650964.360606:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1788650964.360636:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x84a2fba887976fec 00000004:00100000:2.0:1788650964.360677:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788650964.360903:0:5843:0:(import.c:65:import_set_state_nolock()) 0000000074d08d4b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788650964.360954:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cb91866 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875536408218880:12345-0@lo:38: Request processed in 366us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650964.360967:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788650964.360999:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ec24cc3f x1875536408218880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788650974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788650964.361012:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788650964.361019:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788650964.361023:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788650964.361025:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000de101aef lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788650964.361029:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec24cc3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408218880:0@lo:38: 00000100:00100000:2.0:1788650964.361055:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408218752:0@lo:101: 00010000:00010000:2.0:1788650964.361067:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.361076:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650964.361135:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408219008:0@lo:256: 00000100:00100000:2.0:1788650964.361165:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650964.361180:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0ee64e3 going to sleep for 11 seconds 00000100:00100000:2.0:1788650964.361193:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219008 00000100:00100000:2.0:1788650964.361196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219008 00000100:00100000:2.0:1788650964.361217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788650964.361222:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba506371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408219008:12345-0@lo:256: 20000000:01000000:2.0:1788650964.361233:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788650964.361245:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788650964.361248:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788650964.361310:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba506371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408219008:12345-0@lo:256: Request processed in 88us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650964.361320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788650964.361347:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408219008:0@lo:256: 10000000:01000000:2.0:1788650964.361382:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788650964.361388:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650964.361395:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 0000000013aa2160/0x84a2fba887976fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788650964.695951:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788650965.317165:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650966.350599:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650967.364396:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650968.388379:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650969.418367:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788650969.480599:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408219136:0@lo:400: 00000100:00100000:3.0:1788650969.480994:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec24cc3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408219264:0@lo:400: 00000100:00100000:3.0:1788650969.481035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650969.481140:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219264 00000100:00100000:3.0:1788650969.481149:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219264 00000100:00100000:3.0:1788650969.481206:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650969.481358:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650969.481400:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219136 00000100:00100000:2.0:1788650969.481405:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219136 00000100:00100000:2.0:1788650969.481439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788650969.481447:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000483345b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3308:x1875536408219136:12345-0@lo:400: 00000100:00100000:2.0:1788650969.481506:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000483345b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3308:x1875536408219136:12345-0@lo:400: Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650969.481514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788650969.481567:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e2c8b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408219136:0@lo:400: 00000100:00100000:2.0:1788650969.485977:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbe1d3a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408219264:12345-0@lo:400: 00000100:00100000:2.0:1788650969.486196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbe1d3a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408219264:12345-0@lo:400: Request processed in 4575us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650969.486209:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788650969.486407:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ec24cc3f x1875536408219264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788650985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788650969.486426:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec24cc3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408219264:0@lo:400: 00000020:00000080:1.0:1788650970.272934:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea093a240 20000000:00000080:1.0:1788650970.272959:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93be443bb000 uarg=0000000000000000 20000000:01000000:1.0:1788650970.273003:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788650970.273011:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788650970.273017:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788650970.277271:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788650970.277303:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788650970.285370:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788650970.285708:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788650970.285769:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788650970.285831:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788650970.285860:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788650970.285887:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650970.285940:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976fad expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650970.285949:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.297400:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976fad expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.297457:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976fad expref: 11 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650970.297478:0:6322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002330eafe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875536408219392:0@lo:104: 00000100:00100000:2.0:1788650970.297567:0:6322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650970.297664:0:6322:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b3d2554 going to sleep for 11 seconds 00000100:00100000:1.0:1788650970.297779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219392 00000100:00100000:1.0:1788650970.297796:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219392 00000100:00100000:1.0:1788650970.297877:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788650970.297887:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e2c8b53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:6322:x1875536408219392:12345-0@lo:104: 00010000:00010000:1.0:1788650970.297910:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650970.297982:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788650970.297987:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e2c8b53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:6322:x1875536408219392:12345-0@lo:104: Request processed in 103us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650970.298004:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788650970.298013:0:6322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002330eafe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875536408219392:0@lo:104: 00010000:00010000:2.0:1788650970.298038:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650970.298092:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788650970.298099:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650970.298132:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f95d68c8 already unused, calling callback (000000004a30fc29) 10000000:00010000:3.0:1788650970.298136:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650970.298144:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788650970.298151:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650970.298156:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788650970.298200:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650970.298207:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788650970.298232:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650970.298235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788650970.298239:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: 00000000f95d68c8/0x84a2fba887976fad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fb4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650970.298257:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650970.298259:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650970.298260:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650970.299601:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d742d3b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408219520:0@lo:103: 00000100:00100000:1.0:1788650970.299690:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650970.299762:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219520 00000100:00100000:2.0:1788650970.299773:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219520 00010000:00010000:2.0:1788650970.299832:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976fad expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650970.299876:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788650970.299884:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037cbcfe5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3307:x1875536408219520:12345-0@lo:103: 00010000:00010000:2.0:1788650970.299914:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788650970.299921:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976fad expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.299937:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976fad expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.299957:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000052cc97/0x84a2fba887976fb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976fad expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.299979:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300000:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300019:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300026:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300034:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300041:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300052:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c71e3fda already unused, calling callback (000000006fa6c9fc) 00010000:00010000:2.0:1788650970.300056:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300064:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300082:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650970.300093:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788650970.300244:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037cbcfe5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:3307:x1875536408219520:12345-0@lo:103: Request processed in 361us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650970.300253:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788650970.300834:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650970.300845:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650970.300851:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c71e3fda/0x84a2fba887976ff3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650970.309439:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d742d3b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408219520:0@lo:103: 00010000:00010000:3.0:1788650970.437445:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650971.461534:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650972.489180:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650973.509296:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650974.535333:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788650974.599368:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788650974.599391:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001327dd1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408219776:0@lo:400: 00000100:00100000:3.0:1788650974.599452:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650974.599487:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788650974.599495:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7924a61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408219648:0@lo:400: 00000100:00100000:1.0:1788650974.599529:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650974.599609:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219776 00000100:00100000:2.0:1788650974.599625:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219776 00000100:00100000:2.0:1788650974.599674:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788650974.599681:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d29ea1c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408219776:12345-0@lo:400: 00000100:00100000:2.0:1788650974.599737:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d29ea1c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408219776:12345-0@lo:400: Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650974.599744:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788650974.599790:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001327dd1b x1875536408219776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788650990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650974.599803:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001327dd1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408219776:0@lo:400: 00000100:00100000:3.0:1788650974.600492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219648 00000100:00100000:3.0:1788650974.600497:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219648 00000100:00100000:3.0:1788650974.600625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788650974.600632:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb565a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:3306:x1875536408219648:12345-0@lo:400: 00000100:00100000:3.0:1788650974.600680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb565a13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:3306:x1875536408219648:12345-0@lo:400: Request processed in 50us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650974.600687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788650974.601513:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7924a61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408219648:0@lo:400: 00010000:00010000:2.0:1788650975.558843:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650976.580419:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788650977.156390:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788650977.156397:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be4384a800 from 1 10000000:01000000:2.0:1788650977.156401:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788650977.156438:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000ebe80934/0x84a2fba887976ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.156449:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000ebe80934/0x84a2fba887976ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.156460:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000ebe80934/0x84a2fba887976ffa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.156481:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dc6d00c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408219904:0@lo:101: 00000100:00100000:2.0:1788650977.156543:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.156602:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4003f4e going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.156727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408219904 00000100:00100000:0.0:1788650977.156734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408219904 00000100:00100000:0.0:1788650977.156782:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788650977.156789:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084249a68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+11:5838:x1875536408219904:12345-0@lo:101: 00010000:00010000:0.0:1788650977.156801:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650977.156812:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d216087/0x84a2fba887977001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887976ffa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.156842:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d216087/0x84a2fba887977001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887976ffa expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.156861:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d216087/0x84a2fba887977001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976ffa expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.156869:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d216087, rc 0) 00000100:00100000:0.0:1788650977.156909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084249a68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408219904:12345-0@lo:101: Request processed in 121us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.156930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788650977.156976:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dc6d00c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408219904:0@lo:101: 00010000:00010000:0.0:1788650977.156988:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000ebe80934/0x84a2fba887976ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.156997:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000ebe80934/0x84a2fba887976ffa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650977.157047:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca62b05d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408220032:0@lo:501: 00000100:00100000:0.0:1788650977.157073:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.157086:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4ceedc1 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.157097:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220032 00000100:00100000:0.0:1788650977.157100:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220032 00000100:00100000:0.0:1788650977.157148:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788650977.157153:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040a8436a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408220032:12345-0@lo:501: 00000100:00100000:0.0:1788650977.157373:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040a8436a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408220032:12345-0@lo:501: Request processed in 220us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.157380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788650977.157406:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca62b05d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408220032:0@lo:501: 00000100:00100000:0.0:1788650977.157432:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca62b05d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408220160:0@lo:503: 00000100:00100000:0.0:1788650977.157467:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.157479:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4ceedc1 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.157489:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220160 00000100:00100000:0.0:1788650977.157493:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220160 00000100:00100000:0.0:1788650977.157511:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788650977.157516:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b3244b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408220160:12345-0@lo:503: 00000100:00100000:0.0:1788650977.159417:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b3244b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408220160:12345-0@lo:503: Request processed in 1895us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.159430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788650977.160016:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca62b05d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408220160:0@lo:503: 00000100:00100000:2.0:1788650977.160525:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025652a38 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:6671:1875536408220288:0@lo:502: 00000100:00100000:2.0:1788650977.160591:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.160655:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4003f4e going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.161353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220288 00000100:00100000:0.0:1788650977.161361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220288 00000100:00100000:0.0:1788650977.161400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788650977.161407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000151e8fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6671:x1875536408220288:12345-0@lo:502: 00000100:00100000:0.0:1788650977.161657:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000151e8fb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6671:x1875536408220288:12345-0@lo:502: Request processed in 250us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.161664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788650977.162241:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025652a38 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:6671:1875536408220288:0@lo:502: 00000020:01000000:2.0:1788650977.162273:0:6671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788650977.162283:0:6671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788650977.162285:0:6671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788650977.162294:0:6671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be4384a800 00000020:00000080:2.0:1788650977.162297:0:6671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788650977.162341:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:6671:1875536408220416:0@lo:502: 00000100:00100000:2.0:1788650977.162384:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.162421:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be43ee1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788650977.162634:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220416 00000100:00100000:1.0:1788650977.162650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220416 00000100:00100000:1.0:1788650977.162694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788650977.162702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6671:x1875536408220416:12345-0@lo:502: 00000100:00100000:1.0:1788650977.163089:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6671:x1875536408220416:12345-0@lo:502: Request processed in 387us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650977.163096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788650977.166753:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:6671:1875536408220416:0@lo:502: 00000020:01000000:2.0:1788650977.166802:0:6671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788650977.166811:0:6671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788650977.166814:0:6671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788650977.166829:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788650977.167083:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788650977.167141:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788650977.167151:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.167163:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788650977.383452:0:6669:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788650977.383456:0:6669:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788650977.383593:0:6669:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93be7bfe0800 00000020:01000004:2.0:1788650977.383608:0:6669:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788650977.383619:0:6669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788650977.383632:0:6669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93be45c64d40) 00000020:00000080:2.0:1788650977.384195:0:6669:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788650977.400332:0:6669:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788650977.400591:0:6669:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788650977.425472:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788650977.430565:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788650977.430597:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788650977.430749:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788650977.430780:0:6669:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788650977.431561:0:6669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788650977.431575:0:6669:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788650977.431584:0:6669:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84a2fba88797700f 00000020:01000004:2.0:1788650977.431592:0:6669:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788650977.431612:0:6669:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788650977.431615:0:6669:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788650977.431621:0:6669:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788650977.431625:0:6669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788650977.431698:0:6669:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93be45c60000) 00000020:00000080:2.0:1788650977.431711:0:6669:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788650977.433174:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788650977.433318:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788650977.433323:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788650977.436798:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788650977.436809:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788650977.438372:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788650977.438381:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788650977.440377:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788650977.440573:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788650977.440586:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788650977.446069:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788650977.446083:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788650977.485919:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788650977.486305:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788650977.486312:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788650977.490685:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788650977.490705:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788650977.491708:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788650977.491717:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788650977.494243:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788650977.494434:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788650977.494441:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788650977.496324:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788650977.496335:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788650977.584858:0:6669:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788650977.585785:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788650977.585792:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788650977.590872:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788650977.590888:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788650977.599778:0:6669:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788650977.599809:0:6669:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788650977.599815:0:6669:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:1.0:1788650977.604272:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788650977.627622:0:6669:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788650977.627658:0:6669:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788650977.627662:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788650977.627664:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788650977.627665:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650977.627666:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650977.627667:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650977.627669:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650977.627670:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650977.627672:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650977.627673:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650977.627674:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650977.627676:0:6669:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788650977.627679:0:6669:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788650977.627681:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788650977.627686:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788650977.627687:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650977.627688:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650977.627689:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650977.627690:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650977.627691:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650977.627692:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650977.627693:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650977.627694:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650977.627695:0:6669:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788650977.627718:0:6669:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788650977.627735:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408220544:0@lo:253: 00000100:00100000:2.0:1788650977.627800:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.627863:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.627896:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220544 00000100:00100000:0.0:1788650977.627904:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220544 00000100:00100000:0.0:1788650977.627956:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788650977.627966:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408220544:12345-0@lo:253: 20000000:01000000:0.0:1788650977.628001:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788650977.628005:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788650977.628010:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788650977.628012:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788650977.628865:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788650977.629039:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788650977.629054:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788650977.629094:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788650977.629102:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788650977.629170:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788650977.629222:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788650977.629555:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788650977.629571:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:0.0:1788650977.629573:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788650977.629602:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788650977.629608:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788650977.629675:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788650977.629683:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:0.0:1788650977.629715:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788650977.629725:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788650977.629753:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788650977.629796:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788650977.632542:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788650977.632571:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:0.0:1788650977.632573:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788650977.632769:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788650977.632794:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788650977.632832:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788650977.632840:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:0.0:1788650977.632901:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788650977.632912:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788650977.632945:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788650977.632979:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788650977.632994:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788650977.632997:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788650977.633003:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788650977.633004:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788650977.633007:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788650977.633019:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788650977.633021:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788650977.633051:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788650977.633054:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788650977.633836:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788650977.634375:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788650977.634417:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788650977.634482:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788650977.634496:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788650977.634498:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788650977.634989:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788650977.635039:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788650977.636727:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788650977.637071:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788650977.637173:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788650977.637217:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788650977.637231:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788650977.637234:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788650977.637708:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788650977.637755:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788650977.637813:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788650977.638035:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788650977.638074:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788650977.638178:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1788650977.638197:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788650977.638216:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638233:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f2f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638241:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976f4b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638258:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976fbb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638265:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638301:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976fbb expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638315:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976fbb expref: 12 pid: 5833 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.638328:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408220672:0@lo:104: 00000100:00100000:2.0:1788650977.638384:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788650977.638445:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976f4b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638453:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976f4b expref: 12 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.638461:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408220800:0@lo:104: 00000100:00100000:2.0:1788650977.638482:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788650977.638504:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976f2f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.638512:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976f2f expref: 12 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.638520:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408220928:0@lo:104: 00000100:00100000:2.0:1788650977.638546:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.638556:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28180 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.638621:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220672 00000100:00100000:0.0:1788650977.638628:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220672 00000100:00100000:0.0:1788650977.638657:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220800 00000100:00100000:0.0:1788650977.638660:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220800 00000100:00100000:0.0:1788650977.638670:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408220928 00000100:00100000:0.0:1788650977.638672:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408220928 00000100:00100000:0.0:1788650977.638684:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.638692:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5833:x1875536408220672:12345-0@lo:104: 00010000:00010000:0.0:1788650977.638710:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.638767:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788650977.638773:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5833:x1875536408220672:12345-0@lo:104: Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.638780:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.638796:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788650977.638802:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+4:5833:x1875536408220800:12345-0@lo:104: 00010000:00010000:0.0:1788650977.638810:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.638841:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788650977.638856:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+4:5833:x1875536408220800:12345-0@lo:104: Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.638863:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788650977.638875:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788650977.638881:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5833:x1875536408220928:12345-0@lo:104: 00010000:00010000:0.0:1788650977.638889:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.638914:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788650977.638919:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5833:x1875536408220928:12345-0@lo:104: Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.638925:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788650977.638941:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788650977.638946:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.638959:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cac00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788650977.638963:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.638972:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788650977.638978:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650977.638984:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788650977.639012:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639018:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788650977.639036:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba887976fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fc2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639057:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788650977.639060:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639066:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cbc00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788650977.639068:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639086:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788650977.639093:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650977.639097:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788650977.639132:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639138:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788650977.639153:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639160:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cbc00/0x84a2fba887976f4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976f52 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639171:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788650977.639174:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639180:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cae00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788650977.639183:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639189:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788650977.639195:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650977.639209:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788650977.639222:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639228:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788650977.639234:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639240:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887976f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976f36 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639254:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650977.639256:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650977.639257:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788650977.639278:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408221056:0@lo:103: 00000100:00100000:0.0:1788650977.639305:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.639340:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408221184:0@lo:103: 00000100:00100000:0.0:1788650977.639360:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.639382:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788650977.639388:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408221312:0@lo:103: 00000100:00100000:0.0:1788650977.639406:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.639433:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221056 00000100:00100000:0.0:1788650977.639438:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221056 00010000:00010000:0.0:1788650977.639456:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976fbb expref: 13 pid: 5833 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650977.639471:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221184 00000100:00100000:0.0:1788650977.639473:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221184 00010000:00010000:0.0:1788650977.639494:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976f4b expref: 14 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650977.639505:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221312 00000100:00100000:0.0:1788650977.639508:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221312 00010000:00010000:0.0:1788650977.639518:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976f2f expref: 15 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650977.639531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.639536:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:3309:x1875536408221056:12345-0@lo:103: 00010000:00010000:0.0:1788650977.639557:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788650977.639563:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976fbb expref: 15 pid: 5833 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639573:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976fbb expref: 15 pid: 5833 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639587:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788650977.639615:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:3309:x1875536408221056:12345-0@lo:103: Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.639623:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.639636:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788650977.639642:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3306:x1875536408221184:12345-0@lo:103: 00010000:00010000:0.0:1788650977.639649:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788650977.639654:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976f4b expref: 14 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639663:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976f4b expref: 14 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639682:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788650977.639710:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3306:x1875536408221184:12345-0@lo:103: Request processed in 69us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.639716:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788650977.639728:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788650977.639734:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3306:x1875536408221312:12345-0@lo:103: 00010000:00010000:0.0:1788650977.639740:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788650977.639745:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976f2f expref: 13 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639754:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976f2f expref: 13 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639767:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639775:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639788:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639795:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639802:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639808:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639818:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788650977.639822:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639830:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639838:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.639864:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788650977.639889:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3306:x1875536408221312:12345-0@lo:103: Request processed in 156us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.639895:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788650977.639927:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408221056:0@lo:103: 00000100:00100000:0.0:1788650977.639946:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408221312:0@lo:103: 00000100:00100000:0.0:1788650977.639952:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408221184:0@lo:103: 00010000:00010000:2.0:1788650977.640242:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030e00/0x84a2fba887976fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976fbb expref: 12 pid: 5833 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.640254:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408220672:0@lo:104: 00010000:00010000:2.0:1788650977.640264:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030000/0x84a2fba887976f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976f4b expref: 11 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.640272:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408220800:0@lo:104: 00010000:00010000:2.0:1788650977.640282:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cda00/0x84a2fba887976f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976f2f expref: 10 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.640290:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408220928:0@lo:104: 00010000:00010000:2.0:1788650977.640307:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.640317:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.640323:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.640329:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd400/0x84a2fba88797701d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788650977.640341:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788650977.640555:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788650977.681299:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+9:6669:x1875536408220544:12345-0@lo:253: Request processed in 53326us (53489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650977.681314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788650977.681391:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408220544:0@lo:253: 10000000:01000000:2.0:1788650977.681406:0:6669:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788650977.681415:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788650977.681417:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788650977.681418:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650977.681419:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788650977.681421:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650977.681422:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650977.681423:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650977.681425:0:6669:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788650977.681427:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650977.681428:0:6669:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788650977.681444:0:6669:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93be7bfe0800 from lustre-OST0000 10000000:01000000:2.0:1788650977.681465:0:6669:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788650977.681468:0:6669:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788650977.681474:0:6669:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93be45690000 local copy 10000000:01000000:2.0:1788650977.681477:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788650977.681508:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.681519:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.681528:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.681545:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221440:0@lo:101: 00000100:00100000:2.0:1788650977.681577:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.681662:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788650977.681760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221440 00000100:00100000:1.0:1788650977.681767:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221440 00000100:00100000:1.0:1788650977.681830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788650977.681839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+9:6669:x1875536408221440:12345-0@lo:101: 00010000:00010000:1.0:1788650977.681859:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788650977.681871:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670600/0x84a2fba88797702b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977024 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650977.681892:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670600/0x84a2fba88797702b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977024 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650977.681902:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670600/0x84a2fba88797702b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977024 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650977.681910:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670600, rc 0) 00000100:00100000:1.0:1788650977.681947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+10:6669:x1875536408221440:12345-0@lo:101: Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650977.681953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788650977.682003:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221440:0@lo:101: 00010000:00010000:3.0:1788650977.682015:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.682024:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.682135:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221568:0@lo:501: 00000100:00100000:3.0:1788650977.682166:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.682318:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.682374:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221568 00000100:00100000:2.0:1788650977.682377:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221568 00000100:00100000:2.0:1788650977.682396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788650977.682401:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+10:6669:x1875536408221568:12345-0@lo:501: 00000100:00100000:2.0:1788650977.682578:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+10:6669:x1875536408221568:12345-0@lo:501: Request processed in 176us (410us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788650977.682592:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788650977.682673:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221568:0@lo:501: 10000000:01000000:3.0:1788650977.682685:0:6669:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788650977.682707:0:6669:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788650977.682712:0:6669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.682720:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.682728:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.682750:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788650977.682765:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93be7bfe0800 10000000:01000000:3.0:1788650977.682769:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788650977.682773:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93be45690000 10000000:01000000:3.0:1788650977.682775:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788650977.682778:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93be45690000 from 1 10000000:01000000:3.0:1788650977.682780:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788650977.682794:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.682802:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.682809:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.682829:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221696:0@lo:101: 00000100:00100000:3.0:1788650977.682863:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.682874:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.683004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221696 00000100:00100000:2.0:1788650977.683009:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221696 00000100:00100000:2.0:1788650977.683025:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788650977.683030:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+10:6669:x1875536408221696:12345-0@lo:101: 00010000:00010000:2.0:1788650977.683037:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650977.683045:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cda00/0x84a2fba887977039 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977032 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683058:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cda00/0x84a2fba887977039 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977032 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683066:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cda00/0x84a2fba887977039 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977032 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683073:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cda00, rc 0) 00000100:00100000:2.0:1788650977.683104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408221696:12345-0@lo:101: Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.683123:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1788650977.683141:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788650977.683147:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683153:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1788650977.683157:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683166:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788650977.683179:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788650977.683185:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788650977.683200:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683206:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788650977.683223:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683230:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84a2fba88797702b expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683243:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788650977.683244:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788650977.683246:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788650977.683254:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408221824:0@lo:103: 00000100:00100000:2.0:1788650977.683277:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.683304:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221824 00000100:00100000:2.0:1788650977.683307:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221824 00000100:00100000:2.0:1788650977.683330:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650977.683335:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:3308:x1875536408221824:12345-0@lo:103: 00010000:00010000:2.0:1788650977.683343:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788650977.683353:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670600/0x84a2fba88797702b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977024 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683364:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788650977.683389:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+10:3308:x1875536408221824:12345-0@lo:103: Request processed in 54us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.683395:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788650977.683416:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408221824:0@lo:103: 00000100:00100000:3.0:1788650977.683472:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221696:0@lo:101: 00010000:00010000:3.0:1788650977.683483:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.683490:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650977.683502:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788650977.683517:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.683524:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650977.683531:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788650977.683535:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788650977.683538:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788650977.683540:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788650977.683551:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.683558:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.683565:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.683580:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221952:0@lo:101: 00000100:00100000:3.0:1788650977.683602:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.683616:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.683702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408221952 00000100:00100000:2.0:1788650977.683705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408221952 00000100:00100000:2.0:1788650977.683721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788650977.683725:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+10:6669:x1875536408221952:12345-0@lo:101: 00010000:00010000:2.0:1788650977.683732:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650977.683739:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977040 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683751:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977040 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683759:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977040 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.683765:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cd600, rc 0) 00000100:00100000:2.0:1788650977.683788:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408221952:12345-0@lo:101: Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.683793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788650977.683857:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408221952:0@lo:101: 00010000:00010000:3.0:1788650977.683867:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.683875:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.683932:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222080:0@lo:501: 00000100:00100000:3.0:1788650977.683952:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.683969:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.684008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222080 00000100:00100000:2.0:1788650977.684011:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222080 00000100:00100000:2.0:1788650977.684026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788650977.684030:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222080:12345-0@lo:501: 00000100:00100000:2.0:1788650977.684216:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222080:12345-0@lo:501: Request processed in 185us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.684230:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788650977.684350:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222080:0@lo:501: 00000100:00100000:3.0:1788650977.684383:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222208:0@lo:503: 00000100:00100000:3.0:1788650977.684418:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.684440:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.684481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222208 00000100:00100000:2.0:1788650977.684486:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222208 00000100:00100000:2.0:1788650977.684512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788650977.684518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222208:12345-0@lo:503: 00000100:00100000:2.0:1788650977.684752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222208:12345-0@lo:503: Request processed in 234us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.684759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788650977.684870:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222208:0@lo:503: 00000040:00080000:3.0:1788650977.685183:0:6669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788650977.685246:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222336:0@lo:502: 00000100:00100000:3.0:1788650977.685282:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.685299:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.685395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222336 00000100:00100000:2.0:1788650977.685399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222336 00000100:00100000:2.0:1788650977.685430:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788650977.685436:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222336:12345-0@lo:502: 00000100:00100000:2.0:1788650977.685573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222336:12345-0@lo:502: Request processed in 137us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.685580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788650977.685772:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222336:0@lo:502: 00000040:00080000:3.0:1788650977.685981:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788650977.686034:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788650977.686069:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788650977.686149:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788650977.686189:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788650977.686224:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788650977.686248:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222464:0@lo:502: 00000100:00100000:3.0:1788650977.686287:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.686312:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.686484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222464 00000100:00100000:2.0:1788650977.686490:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222464 00000100:00100000:2.0:1788650977.686526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788650977.686533:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222464:12345-0@lo:502: 00000100:00100000:2.0:1788650977.686876:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222464:12345-0@lo:502: Request processed in 342us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.686883:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788650977.686958:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222464:0@lo:502: 00000040:00080000:3.0:1788650977.687037:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788650977.687046:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788650977.687625:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788650977.687700:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788650977.687707:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788650977.687710:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788650977.687717:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788650977.687732:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93be456d0000) 00000020:00000080:0.0:1788650977.687750:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788650977.687756:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788650977.687821:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7bfe0800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788650977.687828:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788650977.687834:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84a2fba887977055 00010000:00010000:0.0:1788650977.693499:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788650977.694577:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788650977.696885:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788650977.697514:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788650977.704623:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788650977.705211:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788650977.706608:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788650977.706620:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650977.706626:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650977.706628:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788650977.706631:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788650977.706647:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650977.706649:0:6688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788650977.706652:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788650977.706655:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788650977.706700:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650977.706704:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650977.706705:0:6688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788650977.706708:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788650977.706901:0:6669:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788650977.706926:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788650977.706952:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.706965:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650977.706973:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7bfe0800 from 1 10000000:01000000:3.0:1788650977.706976:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788650977.707010:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.707018:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.707030:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.707052:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222592:0@lo:101: 00000100:00100000:3.0:1788650977.707162:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.707208:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788650977.708758:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222592 00000100:00100000:1.0:1788650977.708770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222592 00000100:00100000:1.0:1788650977.708817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788650977.708827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+11:6669:x1875536408222592:12345-0@lo:101: 00010000:00010000:1.0:1788650977.708842:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788650977.708865:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797705c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650977.708889:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797705c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650977.708899:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797705c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650977.708908:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670600, rc 0) 00000100:00100000:1.0:1788650977.708968:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222592:12345-0@lo:101: Request processed in 142us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650977.708973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788650977.709092:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222592:0@lo:101: 00010000:00010000:3.0:1788650977.709124:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.709134:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.709236:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222720:0@lo:501: 00000100:00100000:3.0:1788650977.709267:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.709304:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788650977.709757:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222720 00000100:00100000:1.0:1788650977.709764:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222720 00000100:00100000:1.0:1788650977.709795:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788650977.709803:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222720:12345-0@lo:501: 00000100:00100000:1.0:1788650977.711999:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222720:12345-0@lo:501: Request processed in 2190us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650977.712012:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788650977.712099:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222720:0@lo:501: 00000100:00100000:1.0:1788650977.712170:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222848:0@lo:503: 00000100:00100000:1.0:1788650977.712222:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650977.712246:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5957b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788650977.712263:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222848 00000100:00100000:1.0:1788650977.712274:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222848 00000100:00100000:1.0:1788650977.712303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788650977.712310:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222848:12345-0@lo:503: 00000100:00100000:1.0:1788650977.712458:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222848:12345-0@lo:503: Request processed in 147us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650977.712465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788650977.712502:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222848:0@lo:503: 00000040:00080000:1.0:1788650977.713296:0:6669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788650977.713757:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222976:0@lo:502: 00000100:00100000:1.0:1788650977.713809:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650977.713895:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5957b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.713930:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408222976 00000100:00100000:0.0:1788650977.713936:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408222976 00000100:00100000:0.0:1788650977.713975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788650977.713984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222976:12345-0@lo:502: 00000100:00100000:0.0:1788650977.714291:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408222976:12345-0@lo:502: Request processed in 307us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.714299:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788650977.714366:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408222976:0@lo:502: 00000040:00080000:1.0:1788650977.714785:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788650977.714833:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788650977.714876:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223104:0@lo:502: 00000100:00100000:1.0:1788650977.714912:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650977.714944:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5957b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.715019:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223104 00000100:00100000:0.0:1788650977.715024:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223104 00000100:00100000:0.0:1788650977.715055:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788650977.715063:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408223104:12345-0@lo:502: 00000100:00100000:0.0:1788650977.715683:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408223104:12345-0@lo:502: Request processed in 619us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.715691:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788650977.715735:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223104:0@lo:502: 00000040:00080000:0.0:1788650977.715832:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788650977.715842:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788650977.716616:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788650977.716626:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650977.716629:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788650977.716634:0:6692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be7bfe0800 00000020:00000080:1.0:1788650977.716636:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788650977.716655:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650977.716658:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650977.716659:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788650977.716661:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788650977.716901:0:6669:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788650977.716921:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788650977.716945:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.716956:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650977.717010:0:6669:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788650977.717013:0:6669:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93be7bfe0800 10000000:01000000:0.0:1788650977.717016:0:6669:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93be7bfe0800 10000000:01000000:0.0:1788650977.717020:0:6669:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788650977.717025:0:6669:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be7bfe0800 from 1 10000000:01000000:0.0:1788650977.717027:0:6669:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788650977.717062:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.717070:0:6669:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.717080:0:6669:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650977.717098:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223232:0@lo:101: 00000100:00100000:0.0:1788650977.717176:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.717208:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.717388:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223232 00000100:00100000:2.0:1788650977.717395:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223232 00000100:00100000:2.0:1788650977.717434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788650977.717443:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408223232:12345-0@lo:101: 00010000:00010000:2.0:1788650977.717462:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650977.717474:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797706a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.717496:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797706a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.717506:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797706a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650977.717515:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cd400, rc 0) 00000100:00100000:2.0:1788650977.717754:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223232:12345-0@lo:101: Request processed in 311us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.717761:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788650977.717823:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223232:0@lo:101: 00010000:00010000:3.0:1788650977.717838:0:6669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.717857:0:6669:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.717944:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223360:0@lo:501: 00000100:00100000:3.0:1788650977.717973:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.718032:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.718319:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223360 00000100:00100000:2.0:1788650977.718324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223360 00000100:00100000:2.0:1788650977.718387:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788650977.718395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223360:12345-0@lo:501: 00000100:00100000:2.0:1788650977.718729:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223360:12345-0@lo:501: Request processed in 333us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.718736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788650977.718812:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223360:0@lo:501: 00000100:00100000:3.0:1788650977.718855:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223488:0@lo:503: 00000100:00100000:3.0:1788650977.718896:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.718925:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788650977.718979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223488 00000100:00100000:0.0:1788650977.718983:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223488 00000100:00100000:0.0:1788650977.719016:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788650977.719022:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223488:12345-0@lo:503: 00000100:00100000:0.0:1788650977.719188:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223488:12345-0@lo:503: Request processed in 165us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.719195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788650977.719324:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223488:0@lo:503: 00000040:00080000:3.0:1788650977.719570:0:6669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788650977.719622:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223616:0@lo:502: 00000100:00100000:3.0:1788650977.719750:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.719818:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788650977.719874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223616 00000100:00100000:2.0:1788650977.719879:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223616 00000100:00100000:2.0:1788650977.719913:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788650977.719931:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223616:12345-0@lo:502: 00000100:00100000:2.0:1788650977.720338:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223616:12345-0@lo:502: Request processed in 418us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.720345:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788650977.720492:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223616:0@lo:502: 00000040:00080000:3.0:1788650977.720802:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788650977.720864:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788650977.720901:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788650977.720948:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788650977.720987:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788650977.721037:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788650977.721074:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788650977.721441:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788650977.721500:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788650977.721537:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788650977.721572:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788650977.721621:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788650977.721731:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788650977.721768:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788650977.721834:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788650977.721886:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788650977.721921:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788650977.721972:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788650977.722010:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788650977.722056:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788650977.722356:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788650977.722401:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788650977.722434:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788650977.722485:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788650977.722534:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788650977.722567:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788650977.722616:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788650977.722753:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788650977.722796:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223744:0@lo:502: 00000100:00100000:3.0:1788650977.722874:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.722955:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788650977.723006:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223744 00000100:00100000:1.0:1788650977.723013:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223744 00000100:00100000:1.0:1788650977.723090:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788650977.723100:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223744:12345-0@lo:502: 00000100:00100000:1.0:1788650977.723318:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408223744:12345-0@lo:502: Request processed in 219us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650977.723325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788650977.723443:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408223744:0@lo:502: 00000040:00080000:3.0:1788650977.723505:0:6669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788650977.723514:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788650977.724037:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788650977.724052:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93be76590000) 00000020:00000080:3.0:1788650977.724071:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788650977.724170:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7bfe0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788650977.724174:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93be7bfe0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788650977.724177:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be7bfe0800 3 00010000:00080000:3.0:1788650977.724211:0:6693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93bd412bf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1788650977.725816:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788650977.726030:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788650977.726061:0:6693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788650977.726071:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x84a2fba88797707f 00000100:00080000:3.0:1788650977.726079:0:6693:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788650977.726084:0:6693:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93bd412bf000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1788650977.726138:0:6693:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be758c2d80 x1875536408223872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788650977.726165:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788650977.726342:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875536408223872:0@lo:38: 00000100:00100000:2.0:1788650977.726406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650977.728103:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408224000:0@lo:400: 00000100:00100000:2.0:1788650977.728163:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.728726:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408223872 00000100:00100000:0.0:1788650977.728733:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408223872 00000100:00100000:0.0:1788650977.728760:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224000 00000100:00100000:0.0:1788650977.728767:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224000 00000100:00100000:0.0:1788650977.728795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.728802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408224000:12345-0@lo:400: 00000100:00100000:0.0:1788650977.728866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408224000:12345-0@lo:400: Request processed in 64us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.728873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.728887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650977.728891:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875536408223872:12345-0@lo:38: 00010000:00080000:0.0:1788650977.728909:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1788650977.728946:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x84a2fba887977086 00000004:00100000:0.0:1788650977.728959:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788650977.728985:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93be488b9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788650977.729018:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875536408223872:12345-0@lo:38: Request processed in 125us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650977.729024:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788650977.729064:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93be45a7a300 x1875536408224000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788650993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650977.729077:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408224000:0@lo:400: 00000040:00080000:1.0:1788650977.729890:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1788650977.730752:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93be758c2d80 x1875536408223872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788650987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650977.730765:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788650977.730775:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788650977.730782:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788650977.730787:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788650977.730789:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93bd412bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788650977.730795:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875536408223872:0@lo:38: 00000020:01000000:0.0:1788650977.730832:0:6669:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788650977.730867:0:6669:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788650977.730889:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650977.730899:0:6669:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788650977.730948:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788650977.730950:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788650977.730951:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788650977.730953:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788650977.730954:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788650977.730955:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788650977.730957:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788650977.730959:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788650977.730960:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788650977.730961:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788650977.730963:0:6669:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788650977.730966:0:6669:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788650977.730968:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788650977.730970:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788650977.730971:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788650977.730972:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788650977.730973:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788650977.730974:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788650977.730975:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788650977.730976:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788650977.730977:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788650977.730978:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788650977.730979:0:6669:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788650977.730997:0:6669:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788650977.731010:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408224128:0@lo:253: 00000100:00100000:0.0:1788650977.731064:0:6669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650977.731097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224128 00000100:00100000:0.0:1788650977.731127:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224128 00000100:00100000:0.0:1788650977.731168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788650977.731176:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:6669:x1875536408224128:12345-0@lo:253: 20000000:01000000:0.0:1788650977.731210:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788650977.731223:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788650977.733937:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488fa240 going to sleep for 11 seconds 20000000:01000000:3.0:1788650977.753026:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788650977.753039:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788650977.753066:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788650977.753080:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788650977.753102:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753142:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976fde expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753150:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753187:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976fde expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753201:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976fde expref: 13 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.753214:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875536408224256:0@lo:104: 00000100:00100000:3.0:1788650977.753277:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.753319:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788650977.753344:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224256 00000100:00100000:3.0:1788650977.753351:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224256 00000100:00100000:3.0:1788650977.753390:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788650977.753399:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5857:x1875536408224256:12345-0@lo:104: 00010000:00010000:3.0:1788650977.753411:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753456:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788650977.753462:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5857:x1875536408224256:12345-0@lo:104: Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650977.753469:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788650977.753496:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788650977.753501:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753509:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cc400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788650977.753513:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753522:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788650977.753530:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650977.753535:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788650977.753563:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753570:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788650977.753587:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753594:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821cc400/0x84a2fba887976fde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887976fe5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753610:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650977.753612:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650977.753613:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788650977.753631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408224384:0@lo:103: 00000100:00100000:3.0:1788650977.753672:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650977.753707:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224384 00000100:00100000:3.0:1788650977.753717:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224384 00010000:00010000:3.0:1788650977.753745:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976fde expref: 14 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.753766:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788650977.753773:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be460a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3306:x1875536408224384:12345-0@lo:103: 00010000:00010000:3.0:1788650977.753782:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788650977.753786:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976fde expref: 14 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753794:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976fde expref: 14 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753808:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753815:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788650977.753825:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001145438s 00010000:00010000:3.0:1788650977.753829:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753835:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753842:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753859:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753873:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cae00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788650977.753877:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753884:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753891:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.753900:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788650977.753926:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be460a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3306:x1875536408224384:12345-0@lo:103: Request processed in 154us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650977.753932:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788650977.753986:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408224384:0@lo:103: 00010000:00010000:3.0:1788650977.754011:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cdc00/0x84a2fba887976fe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976fde expref: 13 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650977.754020:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875536408224256:0@lo:104: 00010000:00010000:3.0:1788650977.754032:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.754039:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.754045:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650977.754051:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cae00/0x84a2fba88797708d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650977.761366:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:6669:x1875536408224128:12345-0@lo:253: Request processed in 30183us (30293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650977.761380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788650977.761608:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:6669:1875536408224128:0@lo:253: 10000000:01000000:1.0:1788650977.761622:0:6669:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788650977.761625:0:6669:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788650977.761627:0:6669:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788650977.761629:0:6669:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788650977.761630:0:6669:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788650977.761631:0:6669:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788650977.761632:0:6669:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788650977.761644:0:6669:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788650977.761646:0:6669:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788650977.761659:0:6669:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788650977.761661:0:6669:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788650977.761663:0:6669:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788650977.761678:0:6669:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788650977.766211:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650977.766412:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788650977.766710:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650977.766909:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788650977.767149:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650977.771957:0:6669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788650977.773381:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788650977.987326:0:6669:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788650977.987333:0:6669:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788650977.987365:0:6669:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788650977.987420:0:6669:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788650977.987438:0:6669:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788650977.987461:0:6669:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788650978.647069:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650979.652507:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650980.683781:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650981.700405:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650982.731626:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650982.797577:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408224512:0@lo:400: 00000100:00100000:1.0:1788650982.797674:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650982.797798:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408224640:0@lo:400: 00000100:00100000:3.0:1788650982.797842:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650982.797871:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788650982.797877:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408224768:0@lo:400: 00000100:00100000:3.0:1788650982.797903:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650982.797936:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224640 00000100:00100000:3.0:1788650982.797944:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224640 00000100:00100000:3.0:1788650982.797987:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224768 00000100:00100000:3.0:1788650982.797991:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224768 00000100:00100000:3.0:1788650982.798019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788650982.798027:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408224640:12345-0@lo:400: 00000100:00100000:3.0:1788650982.798078:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408224640:12345-0@lo:400: Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650982.798085:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788650982.798099:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788650982.798104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408224768:12345-0@lo:400: 00000100:00100000:3.0:1788650982.798154:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408224768:12345-0@lo:400: Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650982.798160:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788650982.798183:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788650982.798210:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be758c3480 x1875536408224768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788650998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788650982.798241:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408224768:0@lo:400: 00010000:00080000:3.0:1788650982.798255:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be758c3800 x1875536408224640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788650998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788650982.798263:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408224640:0@lo:400: 00000100:00100000:0.0:1788650982.801317:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224512 00000100:00100000:0.0:1788650982.801334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224512 00000100:00100000:0.0:1788650982.801408:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788650982.801420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3307:x1875536408224512:12345-0@lo:400: 00000100:00100000:0.0:1788650982.807752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3307:x1875536408224512:12345-0@lo:400: Request processed in 6324us (10068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650982.807767:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788650982.810097:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408224512:0@lo:400: 00010000:00010000:3.0:1788650983.748420:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788650983.865405:0:7037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788650984.772629:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650985.796972:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788650986.374890:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788650986.374898:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be4384a800 from 21 10000000:01000000:3.0:1788650986.374903:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788650986.374953:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650986.374966:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650986.374977:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650986.375002:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408224896:0@lo:101: 00000100:00100000:3.0:1788650986.375085:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650986.375148:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45fe7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788650986.375732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408224896 00000100:00100000:2.0:1788650986.375741:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408224896 00000100:00100000:2.0:1788650986.375799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788650986.375810:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408224896:12345-0@lo:101: 00010000:00010000:2.0:1788650986.375823:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650986.375837:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977094 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.375859:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977094 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.375871:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977094 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.375880:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cdc00, rc 0) 00000100:00100000:2.0:1788650986.375925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408224896:12345-0@lo:101: Request processed in 117us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650986.375932:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788650986.375979:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408224896:0@lo:101: 00010000:00010000:2.0:1788650986.375994:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.376014:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650986.376070:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225024:0@lo:501: 00000100:00100000:2.0:1788650986.376096:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650986.376187:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.383984:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225024 00000100:00100000:1.0:1788650986.384000:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225024 00000100:00100000:1.0:1788650986.384068:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788650986.384077:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408225024:12345-0@lo:501: 00000100:00100000:1.0:1788650986.384473:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408225024:12345-0@lo:501: Request processed in 397us (8374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.384482:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788650986.384547:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225024:0@lo:501: 00000100:00100000:1.0:1788650986.384595:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225152:0@lo:503: 00000100:00100000:1.0:1788650986.384642:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.384673:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd41086000 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.384688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225152 00000100:00100000:1.0:1788650986.384692:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225152 00000100:00100000:1.0:1788650986.384721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788650986.384728:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408225152:12345-0@lo:503: 00000100:00100000:1.0:1788650986.385003:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408225152:12345-0@lo:503: Request processed in 274us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.385010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788650986.385047:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225152:0@lo:503: 00000100:00100000:1.0:1788650986.385236:0:7158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7158:1875536408225280:0@lo:502: 00000100:00100000:1.0:1788650986.385270:0:7158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.385288:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225280 00000100:00100000:1.0:1788650986.385292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225280 00000100:00100000:1.0:1788650986.385313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788650986.385319:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7158:x1875536408225280:12345-0@lo:502: 00000100:00100000:1.0:1788650986.385501:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7158:x1875536408225280:12345-0@lo:502: Request processed in 182us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.385507:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788650986.385535:0:7158:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd41086240 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.385546:0:7158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7158:1875536408225280:0@lo:502: 00000100:00100000:1.0:1788650986.385585:0:7158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7158:1875536408225408:0@lo:502: 00000100:00100000:1.0:1788650986.385614:0:7158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.385631:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225408 00000100:00100000:1.0:1788650986.385634:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225408 00000100:00100000:1.0:1788650986.385650:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788650986.385660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7158:x1875536408225408:12345-0@lo:502: 00000100:00100000:1.0:1788650986.385760:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7158:x1875536408225408:12345-0@lo:502: Request processed in 99us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.385766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788650986.385803:0:7158:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd41086240 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.385814:0:7158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7158:1875536408225408:0@lo:502: 00000040:00080000:1.0:1788650986.385832:0:7158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788650986.385878:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788650986.385893:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788650986.385904:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.385914:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650986.385924:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788650986.385927:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be4384a800 from 4 10000000:01000000:1.0:1788650986.385929:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788650986.385958:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.385966:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.385976:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650986.385988:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225536:0@lo:101: 00000100:00100000:1.0:1788650986.386012:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.386033:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.386045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225536 00000100:00100000:1.0:1788650986.386048:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225536 00000100:00100000:1.0:1788650986.386068:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788650986.386074:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408225536:12345-0@lo:101: 00010000:00010000:1.0:1788650986.386081:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788650986.386094:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879770a2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386138:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386149:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386156:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670400, rc 0) 00000100:00100000:1.0:1788650986.386184:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408225536:12345-0@lo:101: Request processed in 110us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.386190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788650986.386219:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225536:0@lo:101: 00010000:00010000:1.0:1788650986.386230:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386238:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650986.386275:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225664:0@lo:256: 00000100:00100000:1.0:1788650986.386304:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.386315:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.386331:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225664 00000100:00100000:1.0:1788650986.386335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225664 00000100:00100000:1.0:1788650986.386353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788650986.386359:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408225664:12345-0@lo:256: 20000000:01000000:1.0:1788650986.386371:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788650986.386385:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788650986.386389:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788650986.386456:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408225664:12345-0@lo:256: Request processed in 97us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.386463:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788650986.386490:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225664:0@lo:256: 10000000:01000000:1.0:1788650986.386528:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788650986.386534:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386541:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650986.386547:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788650986.386550:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788650986.386552:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788650986.386566:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386572:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386580:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650986.386600:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225792:0@lo:101: 00000100:00100000:1.0:1788650986.386623:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.386635:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.386647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225792 00000100:00100000:1.0:1788650986.386650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225792 00000100:00100000:1.0:1788650986.386667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788650986.386672:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408225792:12345-0@lo:101: 00010000:00010000:1.0:1788650986.386678:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788650986.386686:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879770b0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386699:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386706:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386714:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670e00, rc 0) 00000100:00100000:1.0:1788650986.386736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408225792:12345-0@lo:101: Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.386741:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788650986.386765:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225792:0@lo:101: 00010000:00010000:1.0:1788650986.386775:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.386782:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650986.389857:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225920:0@lo:501: 00000100:00100000:1.0:1788650986.389921:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.390034:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650986.390534:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408225920 00000100:00100000:0.0:1788650986.390542:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408225920 00000100:00100000:2.0:1788650986.390871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788650986.390883:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408225920:12345-0@lo:501: 00000100:00100000:2.0:1788650986.391347:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408225920:12345-0@lo:501: Request processed in 466us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650986.391356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788650986.391521:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408225920:0@lo:501: 00000100:00100000:0.0:1788650986.391564:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408226048:0@lo:503: 00000100:00100000:0.0:1788650986.391603:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650986.391636:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.391675:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226048 00000100:00100000:1.0:1788650986.391680:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226048 00000100:00100000:1.0:1788650986.391713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788650986.391720:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408226048:12345-0@lo:503: 00000100:00100000:1.0:1788650986.392004:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408226048:12345-0@lo:503: Request processed in 285us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.392011:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788650986.392083:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408226048:0@lo:503: 00000100:00100000:0.0:1788650986.392403:0:7159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7159:1875536408226176:0@lo:502: 00000100:00100000:0.0:1788650986.392440:0:7159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650986.392461:0:7159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266900 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.392500:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226176 00000100:00100000:1.0:1788650986.392504:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226176 00000100:00100000:1.0:1788650986.392534:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788650986.392541:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:7159:x1875536408226176:12345-0@lo:502: 00000100:00100000:1.0:1788650986.392731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:7159:x1875536408226176:12345-0@lo:502: Request processed in 191us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.392738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788650986.392775:0:7159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7159:1875536408226176:0@lo:502: 00000020:01000000:1.0:1788650986.392808:0:7159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788650986.392816:0:7159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788650986.392823:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650986.392825:0:7159:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788650986.392832:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788650986.392836:0:7159:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:1.0:1788650986.392857:0:7159:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788650986.392859:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788650986.392878:0:7159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93be58bf99c0) 00000020:00000080:1.0:1788650986.392897:0:7159:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788650986.392902:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788650986.392967:0:7159:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788650986.392973:0:7159:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788650986.392980:0:7159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba8879770c5 00010000:00080000:1.0:1788650986.393010:0:7159:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be461f6000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1788650986.393249:0:7159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788650986.429586:0:7159:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788650986.429608:0:7159:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788650986.430315:0:7159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788650986.430478:0:7159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788650986.430523:0:7159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788650986.430580:0:7159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788650986.430937:0:7164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788650986.430942:0:7164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788650986.431814:0:7159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788650986.431825:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788650986.431855:0:7159:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788650986.431876:0:7159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879770cc 00000100:00080000:2.0:1788650986.431887:0:7159:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788650986.431893:0:7159:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93be461f6000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1788650986.431928:0:7159:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be6cf4c380 x1875536408226304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788650986.431982:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408226304:0@lo:8: 00000100:00100000:0.0:1788650986.432047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788650986.432159:0:7159:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788650986.432214:0:7159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788650986.432315:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226304 00000100:00100000:3.0:1788650986.432323:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226304 00000100:00100000:3.0:1788650986.432355:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788650986.432364:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875536408226304:12345-0@lo:8: 00010000:00080000:3.0:1788650986.432386:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1788650986.432416:0:6672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879770d3 00002000:00100000:3.0:1788650986.432443:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93bd412bc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788650986.432447:0:6672:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788650986.432452:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788650986.432552:0:6672:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788650986.432670:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788650986.432689:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93bd412b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788650986.432827:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408226432:0@lo:400: 00000100:00100000:1.0:1788650986.432874:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.432899:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788650986.432905:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408226560:0@lo:400: 00000100:00100000:1.0:1788650986.432929:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.432961:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226432 00000100:00100000:1.0:1788650986.432965:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226432 00000100:00100000:1.0:1788650986.432994:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226560 00000100:00100000:1.0:1788650986.432997:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226560 00000100:00100000:1.0:1788650986.433023:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788650986.433029:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408226432:12345-0@lo:400: 00000100:00100000:1.0:1788650986.433069:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408226432:12345-0@lo:400: Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.433076:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788650986.433090:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788650986.433096:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408226560:12345-0@lo:400: 00000100:00100000:1.0:1788650986.433144:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408226560:12345-0@lo:400: Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.433149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788650986.433172:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788650986.433205:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be7bf0ed80 x1875536408226560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650986.433218:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408226560:0@lo:400: 00010000:00080000:1.0:1788650986.433234:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be7bf0c700 x1875536408226432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650986.433243:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408226432:0@lo:400: 00000020:00000080:2.0:1788650986.433305:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788650986.433308:0:7159:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788650986.433316:0:7159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788650986.433322:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788650986.433323:0:7159:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788650986.433327:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788650986.433329:0:7159:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788650986.433352:0:7159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7159:1875536408226688:0@lo:502: 00000100:00100000:2.0:1788650986.433393:0:7159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650986.433424:0:7159:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.433482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226688 00000100:00100000:1.0:1788650986.433486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226688 00000100:00100000:1.0:1788650986.433519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788650986.433526:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:7159:x1875536408226688:12345-0@lo:502: 00000100:00100000:1.0:1788650986.433706:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:7159:x1875536408226688:12345-0@lo:502: Request processed in 180us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.433712:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788650986.433783:0:7159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:7159:1875536408226688:0@lo:502: 00000020:01000000:2.0:1788650986.433813:0:7159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788650986.433817:0:7159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788650986.433819:0:7159:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788650986.433823:0:7159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788650986.433957:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788650986.433978:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788650986.433986:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.433997:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650986.434007:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788650986.434010:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93be45690000 from 1 10000000:01000000:1.0:1788650986.434012:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788650986.434033:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.434041:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650986.434056:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650986.434070:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408226816:0@lo:101: 00000100:00100000:1.0:1788650986.434096:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.434144:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd41086240 going to sleep for 11 seconds 00000100:00100000:2.0:1788650986.434211:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226816 00000100:00100000:2.0:1788650986.434215:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226816 00000100:00100000:2.0:1788650986.434235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788650986.434241:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408226816:12345-0@lo:101: 00010000:00010000:2.0:1788650986.434249:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650986.434261:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879770da expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.434281:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879770da expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.434292:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770da expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.434301:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821ccc00, rc 0) 00000100:00100000:2.0:1788650986.434337:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408226816:12345-0@lo:101: Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650986.434343:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788650986.434372:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408226816:0@lo:101: 00010000:00010000:2.0:1788650986.434384:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.434392:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650986.434432:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408226944:0@lo:501: 00000100:00100000:2.0:1788650986.434454:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650986.434466:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650986.434479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408226944 00000100:00100000:2.0:1788650986.434482:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408226944 00000100:00100000:2.0:1788650986.434502:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788650986.434508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408226944:12345-0@lo:501: 00000100:00100000:2.0:1788650986.434693:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408226944:12345-0@lo:501: Request processed in 185us (237us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788650986.434700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788650986.434725:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408226944:0@lo:501: 10000000:01000000:2.0:1788650986.434742:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788650986.434747:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650986.434755:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650986.434995:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875536408226304:12345-0@lo:8: Request processed in 2629us (2946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650986.435005:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788650986.435069:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be6cf4c380 x1875536408226304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788650996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650986.435078:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788650986.435084:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788650986.435091:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788650986.435096:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788650986.435099:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be461f6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788650986.435266:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788650986.435273:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408226304:0@lo:8: 00000004:00080000:0.0:1788650986.435319:0:7164:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788650986.435420:0:7164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190495311900ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788650986.456996:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788650986.478797:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408227072:0@lo:13: 00000100:00100000:3.0:1788650986.478872:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.478991:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227072 00000100:00100000:1.0:1788650986.478999:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227072 00000100:00100000:1.0:1788650986.479051:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788650986.479061:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408227072:12345-0@lo:13: 00002000:00000024:1.0:1788650986.479092:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:0.0:1788650986.479245:0:7165:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788650986.479266:0:7165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227200:0@lo:7: 00000100:00100000:0.0:1788650986.479293:0:7165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.479377:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408227072:12345-0@lo:13: Request processed in 317us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.479386:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788650986.479461:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788650986.479507:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be45a79500 x1875536408227072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788650986.479526:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408227072:0@lo:13: 00000100:00100000:3.0:1788650986.479558:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227200 00000100:00100000:3.0:1788650986.479562:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227200 00000100:00100000:3.0:1788650986.479666:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788650986.479675:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7165:x1875536408227200:12345-0@lo:7: 00000100:00100000:2.0:1788650986.483092:0:7165:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266600 going to sleep for 11 seconds 00002000:00080000:3.0:1788650986.485837:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788650986.485845:0:6675:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788650986.485935:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7165:x1875536408227200:12345-0@lo:7: Request processed in 6257us (6637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650986.485946:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788650986.486102:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be45a79c00 x1875536408227200/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788651002 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650986.486135:0:7165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227200:0@lo:7: 00000004:00080000:2.0:1788650986.486149:0:7165:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788650986.486186:0:7165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227328:0@lo:5: 00000100:00100000:2.0:1788650986.486220:0:7165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650986.486321:0:7165:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1788650986.486443:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227328 00000100:00100000:0.0:1788650986.486450:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227328 00000100:00100000:0.0:1788650986.486531:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788650986.486541:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7165:x1875536408227328:12345-0@lo:5: 00002000:00080000:0.0:1788650986.486564:0:6674:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788650986.486569:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788650986.486832:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7165:x1875536408227328:12345-0@lo:5: Request processed in 292us (610us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788650986.486839:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788650986.486896:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be6cf4d500 x1875536408227328/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651002 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788650986.486926:0:7165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227328:0@lo:5: 00000004:00080000:3.0:1788650986.486935:0:7165:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788650986.486957:0:7165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227456:0@lo:700: 00000100:00100000:3.0:1788650986.486993:0:7165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650986.487016:0:7165:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be43a79300 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.487148:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227456 00000100:00100000:1.0:1788650986.487153:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227456 00000100:00100000:1.0:1788650986.487189:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788650986.487203:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7165:x1875536408227456:12345-0@lo:700: 00000100:00100000:1.0:1788650986.487229:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1875536408227584:0@lo:700: 00000100:00100000:1.0:1788650986.487258:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.487276:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788650986.487293:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227584 00000100:00100000:1.0:1788650986.487297:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227584 00000100:00100000:1.0:1788650986.487320:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788650986.487327:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1875536408227584:12345-0@lo:700: 40000000:02000000:1.0:1788650986.520024:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788650986.530364:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1875536408227584:12345-0@lo:700: Request processed in 43029us (43096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650986.530379:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788650986.530469:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be7bf0ed80 x1875536408227584/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788651002 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650986.530484:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1875536408227584:0@lo:700: 40000000:02000000:0.0:1788650986.530497:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788650986.602308:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788650986.602326:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788650986.602767:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7165:x1875536408227456:12345-0@lo:700: Request processed in 115559us (115768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650986.602783:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788650986.602803:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be758c1c00 x1875536408227456/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788651002 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650986.602814:0:7165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788650986.602831:0:7165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227456:0@lo:700: 00000004:02000040:1.0:1788650986.634388:0:7165:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788650986.638394:0:7165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227712:0@lo:5: 00000100:00100000:1.0:1788650986.638462:0:7165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650986.638515:0:7165:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788650986.639170:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227712 00000100:00100000:2.0:1788650986.639179:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227712 00000100:00100000:2.0:1788650986.639306:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788650986.639319:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7165:x1875536408227712:12345-0@lo:5: 00002000:00080000:2.0:1788650986.653878:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788650986.653899:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788650986.657756:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7165:x1875536408227712:12345-0@lo:5: Request processed in 18433us (19284us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788650986.657770:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788650986.657898:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be7bf0f480 x1875536408227712/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651002 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650986.657916:0:7165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1875536408227712:0@lo:5: 00000004:00080000:0.0:1788650986.657932:0:7165:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788650986.830557:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650987.847556:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788650987.950390:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788650988.870225:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650989.892275:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650990.916622:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788650991.492666:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408227840:0@lo:13: 00000100:00100000:3.0:1788650991.492737:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650991.492917:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227840 00000100:00100000:0.0:1788650991.492938:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227840 00000100:00100000:0.0:1788650991.493010:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788650991.493020:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408227840:12345-0@lo:13: 00002000:00000024:0.0:1788650991.493054:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788650991.493102:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408227840:12345-0@lo:13: Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650991.493134:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788650991.493155:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788650991.493177:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be45a7bb80 x1875536408227840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650991.493188:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788650991.493213:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408227840:0@lo:13: 00000100:00100000:3.0:1788650991.494864:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788650991.494885:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408228224:0@lo:400: 00000100:00100000:3.0:1788650991.494940:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650991.495157:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408227968:0@lo:400: 00000100:00100000:2.0:1788650991.495198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650991.495233:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788650991.495251:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408228096:0@lo:400: 00000100:00100000:2.0:1788650991.495286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650991.495321:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228224 00000100:00100000:2.0:1788650991.495412:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228224 00000100:00100000:2.0:1788650991.495464:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228096 00000100:00100000:2.0:1788650991.495468:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228096 00000100:00100000:2.0:1788650991.495491:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788650991.495499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408228224:12345-0@lo:400: 00000100:00100000:2.0:1788650991.495550:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408228224:12345-0@lo:400: Request processed in 52us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650991.495558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788650991.495574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788650991.495581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408228096:12345-0@lo:400: 00000100:00100000:2.0:1788650991.495612:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408228096:12345-0@lo:400: Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650991.495619:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788650991.495648:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788650991.495676:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be758c1c00 x1875536408228096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650991.495691:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408228096:0@lo:400: 00010000:00080000:2.0:1788650991.495723:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be758c3800 x1875536408228224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650991.495732:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408228224:0@lo:400: 00000100:00100000:3.0:1788650991.499763:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408227968 00000100:00100000:3.0:1788650991.499777:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408227968 00000100:00100000:3.0:1788650991.499840:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788650991.499850:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3306:x1875536408227968:12345-0@lo:400: 00000100:00100000:3.0:1788650991.499938:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3306:x1875536408227968:12345-0@lo:400: Request processed in 90us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650991.499946:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788650991.500083:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408227968:0@lo:400: 00010000:00010000:1.0:1788650991.940644:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650992.965567:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788650993.267963:0:7617:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788650993.267968:0:7617:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788650993.268268:0:7617:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93bd412bd800 00000020:01000004:3.0:1788650993.268284:0:7617:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788650993.268296:0:7617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788650993.268309:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93be765919c0) 00000020:00000080:3.0:1788650993.268328:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788650993.298348:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788650993.298651:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788650993.336990:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788650993.347501:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788650993.347541:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788650993.347595:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788650993.347619:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788650993.348596:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788650993.348609:0:7617:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788650993.348620:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84a2fba8879770ef 00000020:01000004:2.0:1788650993.348629:0:7617:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788650993.348651:0:7617:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788650993.348656:0:7617:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788650993.348662:0:7617:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788650993.348698:0:7617:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788650993.348702:0:7617:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788650993.375922:0:7617:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788650993.375957:0:7617:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.121@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788650993.375962:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788650993.375963:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788650993.375964:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650993.375966:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650993.375967:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650993.375968:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650993.375969:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650993.375971:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650993.375972:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650993.375974:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650993.375975:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788650993.375979:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788650993.375981:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788650993.375982:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788650993.375983:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650993.375985:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650993.375986:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650993.375987:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650993.375988:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650993.375989:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650993.375990:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650993.375991:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650993.375992:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788650993.376020:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788650993.376037:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408228352:0@lo:253: 00000100:00100000:2.0:1788650993.376385:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.376454:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788650993.376550:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228352 00000100:00100000:1.0:1788650993.376558:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228352 00000100:00100000:1.0:1788650993.376614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788650993.376635:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:7617:x1875536408228352:12345-0@lo:253: 20000000:01000000:1.0:1788650993.376667:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788650993.376671:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788650993.376676:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788650993.376679:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788650993.377671:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788650993.377898:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788650993.377912:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788650993.377951:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788650993.377959:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788650993.377991:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788650993.378040:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788650993.378422:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788650993.378441:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:1.0:1788650993.378444:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:1.0:1788650993.378479:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788650993.378487:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788650993.378536:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788650993.378544:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:1.0:1788650993.378576:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788650993.378586:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788650993.378616:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788650993.378667:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788650993.379404:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788650993.379422:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:1.0:1788650993.379424:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:1.0:1788650993.379458:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788650993.379466:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788650993.379497:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788650993.379505:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:1.0:1788650993.379536:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788650993.379554:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788650993.379605:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788650993.379644:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788650993.379662:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788650993.379665:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788650993.379671:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788650993.379673:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788650993.379675:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788650993.379688:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788650993.379690:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788650993.379723:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788650993.379726:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788650993.386416:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788650993.386523:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788650993.386575:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788650993.386983:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788650993.387021:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788650993.387065:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788650993.387077:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788650993.387080:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788650993.388229:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788650993.388286:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788650993.388328:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788650993.392665:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788650993.392825:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788650993.392994:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788650993.393014:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788650993.393017:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788650993.394500:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788650993.395009:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788650993.395053:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788650993.395456:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788650993.395475:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788650993.395477:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788650993.396145:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788650993.396198:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788650993.396250:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788650993.396737:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788650993.396788:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788650993.396907:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788650993.396930:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788650993.396950:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.396968:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977040 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.396977:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797706a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.396984:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977094 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.396991:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.396998:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770da expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397018:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397055:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879770da expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397071:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879770da expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.397085:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228480:0@lo:104: 00000100:00100000:2.0:1788650993.397397:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788650993.397482:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397492:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.397501:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228608:0@lo:104: 00010000:00010000:2.0:1788650993.397538:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977094 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397547:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977094 expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.397555:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228736:0@lo:104: 00010000:00010000:2.0:1788650993.397578:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797706a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397587:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797706a expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.397603:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228864:0@lo:104: 00010000:00010000:2.0:1788650993.397638:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977040 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.397646:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977040 expref: 16 pid: 5834 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.397654:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228992:0@lo:104: 00000100:00100000:2.0:1788650993.397669:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43780 going to sleep for 11 seconds 00000100:00100000:1.0:1788650993.397774:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788650993.397794:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.397864:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.398079:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650993.398098:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228480 00000100:00100000:1.0:1788650993.398354:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.398363:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228608 00000100:00100000:1.0:1788650993.398367:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228608 00000100:00100000:1.0:1788650993.398401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228736 00000100:00100000:1.0:1788650993.398403:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228736 00000100:00100000:1.0:1788650993.398413:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228864 00000100:00100000:1.0:1788650993.398415:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228864 00000100:00100000:1.0:1788650993.398424:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408228992 00000100:00100000:1.0:1788650993.398426:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228992 00000100:00100000:1.0:1788650993.398440:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788650993.398448:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+6:5833:x1875536408228608:12345-0@lo:104: 00010000:00010000:1.0:1788650993.398463:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398640:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788650993.398646:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+6:5833:x1875536408228608:12345-0@lo:104: Request processed in 199us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.398654:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788650993.398672:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788650993.398678:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5833:x1875536408228736:12345-0@lo:104: 00010000:00010000:1.0:1788650993.398687:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398725:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788650993.398730:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:5833:x1875536408228736:12345-0@lo:104: Request processed in 53us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.398736:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788650993.398761:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788650993.398767:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+4:5833:x1875536408228864:12345-0@lo:104: 00010000:00010000:1.0:1788650993.398775:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398802:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788650993.398807:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+4:5833:x1875536408228864:12345-0@lo:104: Request processed in 41us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.398812:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788650993.398824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788650993.398830:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5833:x1875536408228992:12345-0@lo:104: 00010000:00010000:1.0:1788650993.398846:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398880:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788650993.398884:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5833:x1875536408228992:12345-0@lo:104: Request processed in 56us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.398890:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788650993.398909:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788650993.398914:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398920:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788650993.398924:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398932:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788650993.398938:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650993.398943:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788650993.398974:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.398981:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788650993.398997:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399003:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba8879770b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399026:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788650993.399029:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399034:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cae00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788650993.399037:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399043:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788650993.399049:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650993.399054:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788650993.399068:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399074:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788650993.399089:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399096:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cae00/0x84a2fba887977094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797709b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399306:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788650993.399311:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399327:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40030000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788650993.399330:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399337:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788650993.399343:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650993.399348:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788650993.399362:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399367:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788650993.399372:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399378:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be40030000/0x84a2fba88797706a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977071 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399386:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788650993.399389:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399394:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429ca600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788650993.399396:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399410:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788650993.399416:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650993.399420:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788650993.399433:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399438:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788650993.399444:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399450:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429ca600/0x84a2fba887977040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977047 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.399459:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650993.399461:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650993.399463:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650993.399486:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408229120:0@lo:103: 00000100:00100000:1.0:1788650993.399522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650993.399628:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408228480 00000100:00100000:0.0:1788650993.399666:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788650993.399674:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46048050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5833:x1875536408228480:12345-0@lo:104: 00010000:00010000:0.0:1788650993.399683:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.399726:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788650993.399731:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46048050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5833:x1875536408228480:12345-0@lo:104: Request processed in 59us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.399737:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788650993.399791:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408229248:0@lo:103: 00010000:00010000:0.0:1788650993.399816:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788650993.399825:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.399840:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788650993.399843:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.399850:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788650993.399855:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650993.399860:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788650993.399879:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.399885:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788650993.399891:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.399897:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41670200/0x84a2fba8879770da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770e1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.399913:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650993.399915:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650993.399917:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650993.400049:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408229632:0@lo:103: 00000100:00100000:1.0:1788650993.400073:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.400092:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788650993.400098:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408229504:0@lo:103: 00010000:00010000:3.0:1788650993.400298:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650993.400342:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.400416:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408229376:0@lo:103: 00000100:00100000:1.0:1788650993.400451:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.400562:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228608:0@lo:104: 00000100:00100000:2.0:1788650993.400573:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228736:0@lo:104: 00000100:00100000:2.0:1788650993.400581:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228864:0@lo:104: 00000100:00100000:2.0:1788650993.400589:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228992:0@lo:104: 00000100:00100000:2.0:1788650993.400598:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875536408228480:0@lo:104: 00010000:00010000:2.0:1788650993.400624:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650993.400820:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229120 00000100:00100000:3.0:1788650993.400827:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229120 00010000:00010000:3.0:1788650993.400859:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 17 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650993.400875:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229632 00000100:00100000:3.0:1788650993.400878:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229632 00010000:00010000:3.0:1788650993.400888:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879770da expref: 18 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650993.400898:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229504 00000100:00100000:3.0:1788650993.400900:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229504 00010000:00010000:3.0:1788650993.400909:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977040 expref: 19 pid: 5834 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650993.400927:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229376 00000100:00100000:3.0:1788650993.400930:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229376 00010000:00010000:3.0:1788650993.400940:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797706a expref: 20 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650993.400951:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788650993.400958:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3309:x1875536408229120:12345-0@lo:103: 00010000:00010000:3.0:1788650993.400969:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788650993.400975:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 20 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.400983:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 20 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.400998:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670e00/0x84a2fba8879770b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879770b0 expref: 20 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401012:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788650993.401054:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408229120:12345-0@lo:103: Request processed in 97us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.401061:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788650993.401075:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788650993.401080:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:3309:x1875536408229632:12345-0@lo:103: 00010000:00010000:3.0:1788650993.401087:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788650993.401091:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879770da expref: 18 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401099:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879770da expref: 18 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401151:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821ccc00/0x84a2fba8879770e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879770da expref: 18 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401163:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788650993.401186:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:3309:x1875536408229632:12345-0@lo:103: Request processed in 107us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.401192:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788650993.401203:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788650993.401208:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3309:x1875536408229504:12345-0@lo:103: 00010000:00010000:3.0:1788650993.401215:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788650993.401219:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977040 expref: 16 pid: 5834 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401225:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977040 expref: 16 pid: 5834 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401234:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd600/0x84a2fba887977047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977040 expref: 16 pid: 5834 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401242:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788650993.401260:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:3309:x1875536408229504:12345-0@lo:103: Request processed in 53us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.401266:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788650993.401275:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788650993.401280:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3307:x1875536408229376:12345-0@lo:103: 00010000:00010000:3.0:1788650993.401286:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788650993.401290:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797706a expref: 14 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401302:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797706a expref: 14 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401312:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd400/0x84a2fba887977071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797706a expref: 14 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401320:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788650993.401350:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3307:x1875536408229376:12345-0@lo:103: Request processed in 69us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.401356:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788650993.401652:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.401795:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408229504:0@lo:103: 00000100:00100000:2.0:1788650993.401804:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408229632:0@lo:103: 00000100:00100000:2.0:1788650993.401811:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408229120:0@lo:103: 00000100:00100000:3.0:1788650993.401911:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229248 00000100:00100000:3.0:1788650993.401917:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229248 00010000:00010000:3.0:1788650993.401935:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977094 expref: 13 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650993.401961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788650993.401967:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3306:x1875536408229248:12345-0@lo:103: 00010000:00010000:3.0:1788650993.401975:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788650993.401978:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977094 expref: 13 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401986:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977094 expref: 13 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.401997:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cdc00/0x84a2fba88797709b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977094 expref: 13 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402006:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402027:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402041:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402048:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402055:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402061:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402066:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788650993.402071:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402079:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.402099:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.402336:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.402343:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788650993.402358:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788650993.403775:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd800/0x84a2fba8879770f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.403805:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788650993.403894:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3306:x1875536408229248:12345-0@lo:103: Request processed in 1923us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.403914:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788650993.404095:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408229376:0@lo:103: 00000100:00100000:3.0:1788650993.404342:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408229248:0@lo:103: 00000100:00100000:3.0:1788650993.456083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+11:7617:x1875536408228352:12345-0@lo:253: Request processed in 79441us (79691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.456098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788650993.456326:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408228352:0@lo:253: 10000000:01000000:2.0:1788650993.456343:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788650993.456346:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788650993.456347:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788650993.456349:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650993.456350:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788650993.456351:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650993.456352:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650993.456354:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650993.456355:0:7617:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788650993.456357:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650993.456358:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788650993.456380:0:7617:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93bd412bd800 from lustre-OST0001 10000000:01000000:2.0:1788650993.456405:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788650993.456407:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788650993.456415:0:7617:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93be45690000 local copy 10000000:01000000:2.0:1788650993.456419:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788650993.456452:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.456463:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.456471:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.456489:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408229760:0@lo:101: 00000100:00100000:2.0:1788650993.456524:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.456922:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a430c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788650993.457098:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229760 00000100:00100000:3.0:1788650993.457104:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229760 00000100:00100000:3.0:1788650993.457355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788650993.457365:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+11:7617:x1875536408229760:12345-0@lo:101: 00010000:00010000:3.0:1788650993.457378:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788650993.457393:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429cac00/0x84a2fba887977104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879770fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.457418:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cac00/0x84a2fba887977104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879770fd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.457428:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429cac00/0x84a2fba887977104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770fd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.457437:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cac00, rc 0) 00000100:00100000:3.0:1788650993.457483:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408229760:12345-0@lo:101: Request processed in 120us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.457489:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788650993.457564:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408229760:0@lo:101: 00010000:00010000:1.0:1788650993.457578:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.457587:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.457683:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408229888:0@lo:501: 00000100:00100000:1.0:1788650993.457710:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.457960:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.458028:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408229888 00000100:00100000:2.0:1788650993.458045:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408229888 00000100:00100000:2.0:1788650993.458066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788650993.458073:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408229888:12345-0@lo:501: 00000100:00100000:2.0:1788650993.458469:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408229888:12345-0@lo:501: Request processed in 395us (756us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788650993.458487:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788650993.458983:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408229888:0@lo:501: 10000000:01000000:1.0:1788650993.459002:0:7617:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788650993.459034:0:7617:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788650993.459041:0:7617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.459050:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.459058:0:7617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.459270:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788650993.459278:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.459298:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788650993.459302:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.459310:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788650993.459317:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650993.459322:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788650993.459346:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.459351:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788650993.459403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408230016:0@lo:103: 00000100:00100000:3.0:1788650993.459443:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.459518:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230016 00000100:00100000:2.0:1788650993.459524:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230016 00000100:00100000:2.0:1788650993.459570:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788650993.459579:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3306:x1875536408230016:12345-0@lo:103: 00010000:00010000:2.0:1788650993.459590:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788650993.459603:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cac00/0x84a2fba887977104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba8879770fd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.459620:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788650993.459665:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.459675:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650993.459677:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650993.459678:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650993.459788:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788650993.459794:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821cd800/0x84a2fba8879770fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x84a2fba887977104 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650993.459846:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93bd412bd800 10000000:01000000:1.0:1788650993.459851:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788650993.459857:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788650993.459861:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788650993.459866:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788650993.459869:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788650993.459889:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.459897:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.459906:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.459921:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230144:0@lo:101: 00000100:00100000:1.0:1788650993.459951:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.459976:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650993.460088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230144 00000100:00100000:0.0:1788650993.460093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230144 00000100:00100000:0.0:1788650993.460160:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788650993.460168:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408230144:12345-0@lo:101: 00010000:00010000:0.0:1788650993.460178:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650993.460190:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797710b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.460219:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797710b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.460230:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797710b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.460236:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40030a00, rc 0) 00000100:00100000:0.0:1788650993.460264:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230144:12345-0@lo:101: Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.460270:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788650993.460722:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230144:0@lo:101: 00010000:00010000:1.0:1788650993.460737:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.460757:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.460855:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230272:0@lo:501: 00000100:00100000:1.0:1788650993.460884:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.460921:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788650993.460937:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230272 00000100:00100000:1.0:1788650993.460942:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230272 00000100:00100000:1.0:1788650993.460967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788650993.460973:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230272:12345-0@lo:501: 00000100:00100000:1.0:1788650993.461519:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230272:12345-0@lo:501: Request processed in 544us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.461596:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788650993.461643:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230272:0@lo:501: 00000100:00100000:1.0:1788650993.461679:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230400:0@lo:503: 00000100:00100000:1.0:1788650993.461719:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.461750:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788650993.461965:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230400 00000100:00100000:1.0:1788650993.461971:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230400 00000100:00100000:1.0:1788650993.462002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788650993.462009:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230400:12345-0@lo:503: 00000100:00100000:1.0:1788650993.462371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230400:12345-0@lo:503: Request processed in 361us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.462378:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788650993.462438:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230400:0@lo:503: 00000040:00080000:0.0:1788650993.463074:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788650993.463097:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3306:x1875536408230016:12345-0@lo:103: Request processed in 3517us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.463121:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788650993.463321:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408230016:0@lo:103: 00000100:00100000:0.0:1788650993.463334:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230528:0@lo:502: 00000100:00100000:0.0:1788650993.463377:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650993.463413:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7555c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.463469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230528 00000100:00100000:2.0:1788650993.463475:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230528 00000100:00100000:2.0:1788650993.463509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788650993.463516:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408230528:12345-0@lo:502: 00000100:00100000:2.0:1788650993.463772:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408230528:12345-0@lo:502: Request processed in 255us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.463779:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788650993.463908:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230528:0@lo:502: 00000040:00080000:1.0:1788650993.464182:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788650993.464230:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788650993.464266:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788650993.464313:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788650993.464351:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788650993.464386:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788650993.464414:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230656:0@lo:502: 00000100:00100000:1.0:1788650993.464469:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.465238:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441af300 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.465360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230656 00000100:00100000:2.0:1788650993.465369:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230656 00000100:00100000:2.0:1788650993.465415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788650993.465434:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408230656:12345-0@lo:502: 00000100:00100000:2.0:1788650993.465711:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408230656:12345-0@lo:502: Request processed in 279us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.465719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788650993.465811:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230656:0@lo:502: 00000040:00080000:1.0:1788650993.465921:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788650993.465934:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788650993.466611:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788650993.466618:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788650993.466622:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650993.466624:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788650993.466628:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788650993.466640:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93be58bfb380) 00000020:00000080:1.0:1788650993.466656:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788650993.466660:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788650993.466705:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93bd412bd800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788650993.466709:0:7624:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788650993.466714:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84a2fba887977120 00010000:00010000:0.0:1788650993.477723:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788650993.478750:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788650993.482956:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788650993.483941:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788650993.490609:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788650993.491631:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788650993.494371:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788650993.494381:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788650993.494387:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650993.494389:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788650993.494393:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788650993.494397:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650993.494399:0:7624:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788650993.494402:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788650993.494404:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788650993.494458:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788650993.494462:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650993.494463:0:7624:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788650993.494467:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788650993.494636:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788650993.494663:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788650993.494749:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.494763:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650993.494773:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93bd412bd800 from 1 10000000:01000000:1.0:1788650993.494776:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788650993.494812:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.494821:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.494844:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.494866:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230784:0@lo:101: 00000100:00100000:1.0:1788650993.494929:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.494968:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.495292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230784 00000100:00100000:2.0:1788650993.495308:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230784 00000100:00100000:2.0:1788650993.495373:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788650993.495384:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+12:7617:x1875536408230784:12345-0@lo:101: 00010000:00010000:2.0:1788650993.495398:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650993.495411:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977127 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.495434:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977127 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.495445:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977127 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.495453:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cdc00, rc 0) 00000100:00100000:2.0:1788650993.495503:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230784:12345-0@lo:101: Request processed in 121us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.495510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788650993.495529:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230784:0@lo:101: 00010000:00010000:1.0:1788650993.495544:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.495553:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.495677:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230912:0@lo:501: 00000100:00100000:1.0:1788650993.495710:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.495749:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.495826:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408230912 00000100:00100000:2.0:1788650993.495838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408230912 00000100:00100000:2.0:1788650993.495869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788650993.495877:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230912:12345-0@lo:501: 00000100:00100000:2.0:1788650993.496097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408230912:12345-0@lo:501: Request processed in 221us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.496128:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788650993.496161:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408230912:0@lo:501: 00000100:00100000:1.0:1788650993.496187:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231040:0@lo:503: 00000100:00100000:1.0:1788650993.496229:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.496250:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.496489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231040 00000100:00100000:2.0:1788650993.496494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231040 00000100:00100000:2.0:1788650993.496523:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788650993.496538:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231040:12345-0@lo:503: 00000100:00100000:2.0:1788650993.497132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231040:12345-0@lo:503: Request processed in 601us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.497140:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788650993.497158:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231040:0@lo:503: 00000040:00080000:1.0:1788650993.497452:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788650993.497526:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231168:0@lo:502: 00000100:00100000:1.0:1788650993.497564:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.497596:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.497609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231168 00000100:00100000:2.0:1788650993.497614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231168 00000100:00100000:2.0:1788650993.497643:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788650993.497650:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231168:12345-0@lo:502: 00000100:00100000:2.0:1788650993.498137:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231168:12345-0@lo:502: Request processed in 486us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.498144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788650993.498273:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231168:0@lo:502: 00000040:00080000:1.0:1788650993.498867:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788650993.498922:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788650993.498953:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231296:0@lo:502: 00000100:00100000:1.0:1788650993.498997:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.499319:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.499353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231296 00000100:00100000:2.0:1788650993.499360:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231296 00000100:00100000:2.0:1788650993.499431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788650993.499442:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231296:12345-0@lo:502: 00000100:00100000:2.0:1788650993.500016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231296:12345-0@lo:502: Request processed in 576us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.500024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788650993.500688:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231296:0@lo:502: 00000040:00080000:1.0:1788650993.500846:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788650993.500860:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788650993.502677:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788650993.502689:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650993.502691:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788650993.502697:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93bd412bd800 00000020:00000080:1.0:1788650993.502699:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788650993.502717:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788650993.502720:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788650993.502721:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788650993.502724:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788650993.502858:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788650993.502881:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788650993.502898:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.502924:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788650993.502961:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788650993.502964:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93bd412bd800 10000000:01000000:2.0:1788650993.502966:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93bd412bd800 10000000:01000000:2.0:1788650993.502970:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788650993.502975:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93bd412bd800 from 1 10000000:01000000:2.0:1788650993.502977:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788650993.503015:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.503023:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.503033:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.503056:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231424:0@lo:101: 00000100:00100000:2.0:1788650993.503329:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.503374:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43480 going to sleep for 11 seconds 00000100:00100000:1.0:1788650993.503428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231424 00000100:00100000:1.0:1788650993.503435:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231424 00000100:00100000:1.0:1788650993.503550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788650993.503561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408231424:12345-0@lo:101: 00010000:00010000:1.0:1788650993.503574:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788650993.503684:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977135 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.503710:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977135 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.503719:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977135 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.503735:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670e00, rc 0) 00000100:00100000:1.0:1788650993.503832:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231424:12345-0@lo:101: Request processed in 272us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.503838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788650993.503962:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231424:0@lo:101: 00010000:00010000:2.0:1788650993.503977:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.503985:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.504097:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231552:0@lo:501: 00000100:00100000:2.0:1788650993.504258:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.504329:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43480 going to sleep for 11 seconds 00000100:00100000:0.0:1788650993.504369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231552 00000100:00100000:0.0:1788650993.504374:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231552 00000100:00100000:0.0:1788650993.504444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788650993.504452:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231552:12345-0@lo:501: 00000100:00100000:0.0:1788650993.504692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231552:12345-0@lo:501: Request processed in 240us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.504698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788650993.504891:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231552:0@lo:501: 00000100:00100000:1.0:1788650993.504934:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231680:0@lo:503: 00000100:00100000:1.0:1788650993.504972:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.504981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231680 00000100:00100000:2.0:1788650993.504985:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231680 00000100:00100000:1.0:1788650993.504988:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45055240 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.505011:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788650993.505018:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231680:12345-0@lo:503: 00000100:00100000:2.0:1788650993.505195:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231680:12345-0@lo:503: Request processed in 177us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.505265:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231680:0@lo:503: 00000100:00100000:2.0:1788650993.505405:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000040:00080000:1.0:1788650993.505521:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788650993.505587:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231808:0@lo:502: 00000100:00100000:1.0:1788650993.505628:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.505670:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45055240 going to sleep for 11 seconds 00000100:00100000:0.0:1788650993.505734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231808 00000100:00100000:0.0:1788650993.505757:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231808 00000100:00100000:0.0:1788650993.505791:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788650993.505798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231808:12345-0@lo:502: 00000100:00100000:0.0:1788650993.505989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231808:12345-0@lo:502: Request processed in 191us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.505996:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788650993.506024:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231808:0@lo:502: 00000040:00080000:1.0:1788650993.506324:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788650993.506446:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788650993.506504:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788650993.506635:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788650993.506756:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788650993.506809:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788650993.507441:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788650993.507487:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788650993.507617:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788650993.507659:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788650993.507696:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788650993.507755:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788650993.508029:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788650993.508077:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788650993.508246:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788650993.508292:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788650993.508327:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788650993.508459:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788650993.508496:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788650993.508611:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788650993.508966:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788650993.509017:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788650993.509067:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788650993.509137:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788650993.509176:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788650993.509210:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788650993.509259:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788650993.509293:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788650993.509324:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788650993.509392:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788650993.509434:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788650993.509472:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788650993.509513:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788650993.510144:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788650993.510182:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788650993.510222:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788650993.510257:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788650993.510302:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231936:0@lo:502: 00000100:00100000:1.0:1788650993.511653:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650993.511761:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45055240 going to sleep for 11 seconds 00000100:00100000:2.0:1788650993.511881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408231936 00000100:00100000:2.0:1788650993.511889:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408231936 00000100:00100000:2.0:1788650993.511944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788650993.511954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231936:12345-0@lo:502: 00000100:00100000:2.0:1788650993.512207:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408231936:12345-0@lo:502: Request processed in 254us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650993.512214:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788650993.512416:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408231936:0@lo:502: 00000040:00080000:1.0:1788650993.512518:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788650993.513280:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788650993.515754:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788650993.515771:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93be58bfcd40) 00000020:00000080:1.0:1788650993.515793:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788650993.515882:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93bd412bd800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788650993.515886:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93bd412bd800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788650993.515889:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93bd412bd800 3 00010000:00080000:1.0:1788650993.515918:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be6d7b1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1788650993.517630:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788650993.517860:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788650993.517897:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788650993.517909:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x84a2fba88797714a 00000100:00080000:1.0:1788650993.517919:0:7629:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788650993.517924:0:7629:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93be6d7b1000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788650993.517957:0:7629:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be7bf0ca80 x1875536408232064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788650993.517986:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788650993.518094:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408232192:0@lo:400: 00000100:00100000:0.0:1788650993.518157:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408232448:0@lo:400: 00000100:00100000:1.0:1788650993.518178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650993.518190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650993.518220:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232448 00000100:00100000:1.0:1788650993.518226:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408232320:0@lo:400: 00000100:00100000:3.0:1788650993.518229:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232448 00000100:00100000:1.0:1788650993.518254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788650993.518266:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788650993.518289:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232192 00000100:00100000:3.0:1788650993.518291:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788650993.518295:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232192 00000100:00100000:3.0:1788650993.518305:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408232448:12345-0@lo:400: 00000100:00100000:1.0:1788650993.518338:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232320 00000100:00100000:1.0:1788650993.518342:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232320 00000100:00100000:3.0:1788650993.518370:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408232448:12345-0@lo:400: Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.518377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788650993.518381:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788650993.518389:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408232192:12345-0@lo:400: 00010000:00080000:3.0:1788650993.518423:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be45a78000 x1875536408232448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650993.518433:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408232192:12345-0@lo:400: Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.518437:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788650993.518446:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408232320:12345-0@lo:400: 00000100:00100000:1.0:1788650993.518451:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788650993.518460:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408232448:0@lo:400: 00000100:00080000:1.0:1788650993.518475:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788650993.518496:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408232320:12345-0@lo:400: Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.518506:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788650993.518548:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408232064:0@lo:38: 00010000:00080000:1.0:1788650993.519653:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be45a7b100 x1875536408232320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650993.519668:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408232320:0@lo:400: 00010000:00080000:1.0:1788650993.519703:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be45a7a680 x1875536408232192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650993.519712:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408232192:0@lo:400: 00000100:00100000:2.0:1788650993.519923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788650993.522078:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1788650993.522201:0:7630:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff93be758c0700 x1875536408232576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:2.0:1788650993.522210:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:3.0:1788650993.522214:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be46067000 going to sleep for 0 seconds 10000000:01000000:2.0:1788650993.522238:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788650993.522264:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.522275:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788650993.522329:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788650993.522332:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788650993.522333:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650993.522335:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650993.522336:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650993.522337:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650993.522339:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650993.522340:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650993.522342:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650993.522343:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650993.522345:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788650993.522349:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788650993.522351:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788650993.522352:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788650993.522354:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788650993.522355:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788650993.522355:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788650993.522357:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788650993.522358:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788650993.522359:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788650993.522360:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788650993.522361:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788650993.522361:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788650993.522376:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788650993.522385:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408232704:0@lo:253: 00000100:00100000:2.0:1788650993.522445:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.522481:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788650993.522590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232704 00000100:00100000:3.0:1788650993.522604:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232704 00000100:00100000:3.0:1788650993.522648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788650993.522657:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:7617:x1875536408232704:12345-0@lo:253: 20000000:01000000:3.0:1788650993.522682:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788650993.522695:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788650993.525661:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232064 00000100:00100000:0.0:1788650993.525675:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232064 00000100:00100000:0.0:1788650993.526433:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788650993.526443:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875536408232064:12345-0@lo:38: 00010000:00080000:0.0:1788650993.526482:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1788650993.526534:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x84a2fba887977151 00000004:00100000:0.0:1788650993.527252:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788650993.527290:0:5843:0:(import.c:65:import_set_state_nolock()) ffff93be75634000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788650993.527446:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875536408232064:12345-0@lo:38: Request processed in 1003us (7522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.527455:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788650993.527800:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be7bf0ca80 x1875536408232064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650993.527814:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788650993.527894:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788650993.527903:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788650993.527908:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788650993.527918:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788650993.527926:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000029afa685): req@ffff93be758c0700 x1875536408232576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650993.527950:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408232064:0@lo:38: 00000100:00100000:3.0:1788650993.528155:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650993.528179:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be46067000 going to sleep for 11 seconds 00000100:00100000:0.0:1788650993.528273:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232576 00000100:00100000:0.0:1788650993.528280:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232576 00000100:00100000:0.0:1788650993.528379:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788650993.528389:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875536408232576:12345-0@lo:901: 00000100:00100000:0.0:1788650993.528751:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875536408232576:12345-0@lo:901: Request processed in 351us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.528759:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788650993.529953:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788650993.531325:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be758c0700 x1875536408232576/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788651009 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650993.531343:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875536408232576:0@lo:901: 20000000:01000000:3.0:1788650993.546648:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788650993.546667:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788650993.546784:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788650993.546789:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788650993.546812:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.546862:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.546872:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.546910:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650993.546921:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 14 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650993.546932:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875536408232832:0@lo:104: 00000100:00100000:2.0:1788650993.546983:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650993.547067:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a430c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650993.547193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232832 00000100:00100000:0.0:1788650993.547201:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232832 00000100:00100000:0.0:1788650993.547253:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788650993.547264:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5857:x1875536408232832:12345-0@lo:104: 00010000:00010000:0.0:1788650993.547277:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650993.547462:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788650993.547469:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:5857:x1875536408232832:12345-0@lo:104: Request processed in 207us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650993.547476:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788650993.547496:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875536408232832:0@lo:104: 00010000:00010000:3.0:1788650993.547516:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788650993.547516:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.547522:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.547529:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788650993.547533:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.547542:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788650993.547549:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650993.547555:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788650993.547588:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.547595:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788650993.547643:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408232960:0@lo:103: 00000100:00100000:0.0:1788650993.547675:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788650993.547719:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.547724:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408232960 00010000:00010000:3.0:1788650993.547727:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba8879770a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879770a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.547728:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408232960 00010000:00010000:3.0:1788650993.547763:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650993.547763:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.547764:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788650993.547766:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650993.547787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788650993.547794:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be460a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:3306:x1875536408232960:12345-0@lo:103: 00010000:00010000:1.0:1788650993.548469:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788650993.548477:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548488:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548500:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670400/0x84a2fba8879770a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879770a2 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548520:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548603:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788650993.548617:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001828746s 00010000:00010000:1.0:1788650993.548621:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548628:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548635:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548641:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548646:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788650993.548649:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548656:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548676:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650993.548687:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788650993.548695:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.548702:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650993.548708:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd600/0x84a2fba887977158 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650993.548731:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be460a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3306:x1875536408232960:12345-0@lo:103: Request processed in 937us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650993.548749:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788650993.549231:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408232960:0@lo:103: 00000100:00100000:3.0:1788650993.557799:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:7617:x1875536408232704:12345-0@lo:253: Request processed in 35133us (35343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650993.557813:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788650993.557913:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be0363c2-36c6-418a-b340-2685dfcc42ae:7617:1875536408232704:0@lo:253: 10000000:01000000:0.0:1788650993.557929:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788650993.557933:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788650993.557935:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788650993.557936:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788650993.557937:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788650993.557939:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788650993.557940:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788650993.557941:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788650993.557943:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788650993.557957:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788650993.557958:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788650993.557959:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788650993.557975:0:7617:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788650993.567972:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650993.569290:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788650993.569693:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650993.569881:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788650993.570099:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788650993.570497:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788650993.571682:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788650993.777367:0:7617:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788650993.777383:0:7617:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788650993.777415:0:7617:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788650993.777468:0:7617:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788650993.777483:0:7617:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788650993.777508:0:7617:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788650993.988198:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650995.016255:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788650996.038340:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788650996.612657:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408233088:0@lo:13: 00000100:00100000:3.0:1788650996.612733:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650996.613427:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233088 00000100:00100000:1.0:1788650996.613437:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233088 00000100:00100000:1.0:1788650996.613502:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788650996.613512:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408233088:12345-0@lo:13: 00002000:00000024:1.0:1788650996.613547:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788650996.613603:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408233088:12345-0@lo:13: Request processed in 92us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650996.613611:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788650996.613661:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be758c0a80 x1875536408233088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650996.613682:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408233088:0@lo:13: 00000100:00080000:0.0:1788650996.613711:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788650997.060448:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788650998.087008:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788650998.661941:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408233344:0@lo:400: 00000100:00100000:1.0:1788650998.662013:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650998.662075:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788650998.662215:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408233600:0@lo:400: 00000100:00100000:0.0:1788650998.662250:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650998.662278:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788650998.662284:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408233472:0@lo:400: 00000100:00100000:0.0:1788650998.662306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650998.662339:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233600 00000100:00100000:0.0:1788650998.662347:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233600 00000100:00100000:0.0:1788650998.662402:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788650998.662412:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408233600:12345-0@lo:400: 00000100:00100000:0.0:1788650998.662462:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408233600:12345-0@lo:400: Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650998.662469:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788650998.662561:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233344 00000100:00100000:0.0:1788650998.662566:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233344 00000100:00100000:0.0:1788650998.662592:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233472 00000100:00100000:0.0:1788650998.662596:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233472 00000100:00100000:0.0:1788650998.662616:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788650998.662623:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408233344:12345-0@lo:400: 00000100:00100000:0.0:1788650998.662655:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408233344:12345-0@lo:400: Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650998.662662:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788650998.662673:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788650998.662679:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408233472:12345-0@lo:400: 00000100:00100000:0.0:1788650998.662725:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408233472:12345-0@lo:400: Request processed in 47us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650998.662733:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788650998.662750:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788650998.662754:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788650998.662786:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7bf0ea00 x1875536408233472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650998.662801:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408233472:0@lo:400: 00010000:00080000:0.0:1788650998.662812:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7bf0d180 x1875536408233600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788650998.662821:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408233600:0@lo:400: 00000100:00100000:1.0:1788650998.662932:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408233216:0@lo:400: 00000100:00100000:1.0:1788650998.662967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650998.662990:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408233728:0@lo:400: 00000100:00100000:1.0:1788650998.663015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788650998.663038:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7bf0df80 x1875536408233344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650998.663048:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408233344:0@lo:400: 00000100:00100000:1.0:1788650998.663078:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233728 00000100:00100000:1.0:1788650998.663082:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233728 00000100:00100000:1.0:1788650998.663721:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788650998.663730:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408233728:12345-0@lo:400: 00000100:00100000:1.0:1788650998.663780:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408233728:12345-0@lo:400: Request processed in 52us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650998.663787:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788650998.664319:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233216 00000100:00100000:0.0:1788650998.664326:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233216 00000100:00100000:0.0:1788650998.664366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788650998.664375:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3309:x1875536408233216:12345-0@lo:400: 00000100:00100000:0.0:1788650998.664415:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3309:x1875536408233216:12345-0@lo:400: Request processed in 42us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650998.664422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788650998.665772:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788650998.667987:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408233216:0@lo:400: 00010000:00080000:1.0:1788650998.668009:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7bf0f100 x1875536408233728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650998.668022:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408233728:0@lo:400: 00000001:02000400:3.0:1788650999.057342:0:7972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788650999.109837:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788650999.684461:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788650999.684469:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be7bfe0800 from 30 10000000:01000000:1.0:1788650999.684476:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788650999.684518:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.684531:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.684554:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650999.684578:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408233856:0@lo:101: 00000100:00100000:1.0:1788650999.684647:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650999.684714:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be46067b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.684745:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233856 00000100:00100000:3.0:1788650999.684754:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233856 00000100:00100000:3.0:1788650999.684807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788650999.684817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408233856:12345-0@lo:101: 00010000:00010000:3.0:1788650999.684828:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788650999.684841:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797715f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.684865:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797715f expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.684883:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797715f expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.684893:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cb800, rc 0) 00000100:00100000:3.0:1788650999.684942:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408233856:12345-0@lo:101: Request processed in 127us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.684949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788650999.685151:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408233856:0@lo:101: 00010000:00010000:1.0:1788650999.685167:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.685176:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650999.695167:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408233984:0@lo:501: 00000100:00100000:1.0:1788650999.695580:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650999.696933:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be46067b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788650999.706245:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408233984 00000100:00100000:2.0:1788650999.706257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408233984 00000100:00100000:2.0:1788650999.706314:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788650999.706325:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408233984:12345-0@lo:501: 00000100:00100000:2.0:1788650999.706713:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408233984:12345-0@lo:501: Request processed in 389us (11134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.706721:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788650999.706778:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408233984:0@lo:501: 00000100:00100000:2.0:1788650999.706829:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234112:0@lo:503: 00000100:00100000:2.0:1788650999.706874:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.706902:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.707448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234112 00000100:00100000:0.0:1788650999.707454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234112 00000100:00100000:0.0:1788650999.707491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788650999.707500:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408234112:12345-0@lo:503: 00000100:00100000:0.0:1788650999.707795:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408234112:12345-0@lo:503: Request processed in 296us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.707803:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788650999.707857:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234112:0@lo:503: 00000100:00100000:0.0:1788650999.708028:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8006:1875536408234240:0@lo:502: 00000100:00100000:0.0:1788650999.708063:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.708081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234240 00000100:00100000:0.0:1788650999.708084:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234240 00000100:00100000:0.0:1788650999.708103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788650999.708130:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8006:x1875536408234240:12345-0@lo:502: 00000100:00100000:0.0:1788650999.708441:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8006:x1875536408234240:12345-0@lo:502: Request processed in 312us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.708448:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788650999.708484:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.708496:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8006:1875536408234240:0@lo:502: 00000100:00100000:0.0:1788650999.708531:0:8006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8006:1875536408234368:0@lo:502: 00000100:00100000:0.0:1788650999.708559:0:8006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.708576:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234368 00000100:00100000:0.0:1788650999.708579:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234368 00000100:00100000:0.0:1788650999.708598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788650999.708603:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8006:x1875536408234368:12345-0@lo:502: 00000100:00100000:0.0:1788650999.708722:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8006:x1875536408234368:12345-0@lo:502: Request processed in 118us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.708728:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788650999.708754:0:8006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.708764:0:8006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8006:1875536408234368:0@lo:502: 00000040:00080000:0.0:1788650999.708780:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788650999.708819:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788650999.708839:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788650999.708853:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.708863:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650999.708873:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788650999.708875:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788650999.708878:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788650999.708900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.708908:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.708917:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650999.708928:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234496:0@lo:101: 00000100:00100000:0.0:1788650999.708950:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.708962:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.708973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234496 00000100:00100000:0.0:1788650999.708976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234496 00000100:00100000:0.0:1788650999.708994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788650999.709000:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408234496:12345-0@lo:101: 00010000:00010000:0.0:1788650999.709143:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650999.709155:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797716d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.709175:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797716d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.709191:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797716d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.709199:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40030000, rc 0) 00000100:00100000:0.0:1788650999.709227:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408234496:12345-0@lo:101: Request processed in 227us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.709296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788650999.709326:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234496:0@lo:101: 00010000:00010000:0.0:1788650999.709338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.709346:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650999.709382:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234624:0@lo:501: 00000100:00100000:0.0:1788650999.709405:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.709423:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.709432:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234624 00000100:00100000:0.0:1788650999.709436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234624 00000100:00100000:0.0:1788650999.709455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788650999.709461:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408234624:12345-0@lo:501: 00000100:00100000:0.0:1788650999.710153:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408234624:12345-0@lo:501: Request processed in 689us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.710161:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788650999.710205:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234624:0@lo:501: 00000100:00100000:3.0:1788650999.710248:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234752:0@lo:503: 00000100:00100000:3.0:1788650999.710294:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.710323:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4449f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788650999.710363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234752 00000100:00100000:1.0:1788650999.710368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234752 00000100:00100000:1.0:1788650999.710403:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788650999.710411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408234752:12345-0@lo:503: 00000100:00100000:1.0:1788650999.710773:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408234752:12345-0@lo:503: Request processed in 362us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650999.710779:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788650999.710903:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408234752:0@lo:503: 00000100:00100000:3.0:1788650999.711440:0:8008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8008:1875536408234880:0@lo:502: 00000100:00100000:3.0:1788650999.711481:0:8008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.711603:0:8008:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.711635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408234880 00000100:00100000:0.0:1788650999.711641:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408234880 00000100:00100000:0.0:1788650999.711715:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788650999.711723:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8008:x1875536408234880:12345-0@lo:502: 00000100:00100000:0.0:1788650999.711954:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8008:x1875536408234880:12345-0@lo:502: Request processed in 231us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.711962:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788650999.712172:0:8008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8008:1875536408234880:0@lo:502: 00000020:01000000:3.0:1788650999.712200:0:8008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788650999.712209:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650999.712211:0:8008:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788650999.712216:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788650999.712218:0:8008:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788650999.712248:0:8008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8008:1875536408235008:0@lo:502: 00000100:00100000:3.0:1788650999.712281:0:8008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.712386:0:8008:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.712436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235008 00000100:00100000:0.0:1788650999.712440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235008 00000100:00100000:0.0:1788650999.712473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788650999.712479:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8008:x1875536408235008:12345-0@lo:502: 00000100:00100000:0.0:1788650999.712716:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8008:x1875536408235008:12345-0@lo:502: Request processed in 236us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.712722:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788650999.712784:0:8008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8008:1875536408235008:0@lo:502: 00000020:01000000:3.0:1788650999.712808:0:8008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788650999.712812:0:8008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650999.712813:0:8008:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788650999.712817:0:8008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788650999.712950:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788650999.712971:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788650999.712979:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.712990:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650999.712998:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788650999.713001:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be4384a800 from 30 10000000:01000000:0.0:1788650999.713003:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788650999.713088:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.713096:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.713137:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650999.713150:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235136:0@lo:101: 00000100:00100000:0.0:1788650999.713177:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.713199:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.713265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235136 00000100:00100000:3.0:1788650999.713269:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235136 00000100:00100000:3.0:1788650999.713291:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788650999.713298:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408235136:12345-0@lo:101: 00010000:00010000:3.0:1788650999.713306:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788650999.713317:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797717b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.713337:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797717b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.713347:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797717b expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.713355:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cbc00, rc 0) 00000100:00100000:3.0:1788650999.713382:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408235136:12345-0@lo:101: Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.713388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788650999.713576:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235136:0@lo:101: 00010000:00010000:0.0:1788650999.713589:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.713598:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650999.713638:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235264:0@lo:501: 00000100:00100000:0.0:1788650999.713662:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.713683:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.713727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235264 00000100:00100000:3.0:1788650999.713731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235264 00000100:00100000:3.0:1788650999.713757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788650999.713763:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408235264:12345-0@lo:501: 00000100:00100000:3.0:1788650999.713977:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408235264:12345-0@lo:501: Request processed in 213us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.713984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788650999.714096:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235264:0@lo:501: 00000100:00100000:3.0:1788650999.714143:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235392:0@lo:503: 00000100:00100000:3.0:1788650999.714174:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.714186:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.714195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235392 00000100:00100000:3.0:1788650999.714198:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235392 00000100:00100000:3.0:1788650999.714214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788650999.714219:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408235392:12345-0@lo:503: 00000100:00100000:3.0:1788650999.714669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408235392:12345-0@lo:503: Request processed in 448us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.714676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788650999.714739:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235392:0@lo:503: 00000100:00100000:3.0:1788650999.715296:0:8009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8009:1875536408235520:0@lo:502: 00000100:00100000:3.0:1788650999.715334:0:8009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.715391:0:8009:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.715422:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235520 00000100:00100000:0.0:1788650999.715427:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235520 00000100:00100000:0.0:1788650999.715501:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788650999.715509:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8009:x1875536408235520:12345-0@lo:502: 00000100:00100000:0.0:1788650999.715684:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8009:x1875536408235520:12345-0@lo:502: Request processed in 174us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.715690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788650999.715757:0:8009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8009:1875536408235520:0@lo:502: 00000100:00100000:3.0:1788650999.715795:0:8009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8009:1875536408235648:0@lo:502: 00000100:00100000:3.0:1788650999.715824:0:8009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650999.715952:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235648 00000100:00100000:1.0:1788650999.715956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235648 00000100:00100000:1.0:1788650999.715975:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788650999.715981:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8009:x1875536408235648:12345-0@lo:502: 00000100:00100000:1.0:1788650999.716172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8009:x1875536408235648:12345-0@lo:502: Request processed in 190us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650999.716179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788650999.716577:0:8009:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.716594:0:8009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8009:1875536408235648:0@lo:502: 00000040:00080000:3.0:1788650999.716616:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788650999.716783:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788650999.716800:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788650999.716815:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.716825:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788650999.716833:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788650999.716835:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be4384a800 from 5 10000000:01000000:0.0:1788650999.716838:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788650999.716863:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.716871:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.716880:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650999.716893:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235776:0@lo:101: 00000100:00100000:0.0:1788650999.716923:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.716979:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788650999.717065:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235776 00000100:00100000:1.0:1788650999.717069:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235776 00000100:00100000:3.0:1788650999.717417:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788650999.717427:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408235776:12345-0@lo:101: 00010000:00010000:3.0:1788650999.717437:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788650999.717449:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429ca000/0x84a2fba887977190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977189 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.717483:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429ca000/0x84a2fba887977190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977189 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.717562:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429ca000/0x84a2fba887977190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977189 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.717570:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429ca000, rc 0) 00000100:00100000:3.0:1788650999.717613:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408235776:12345-0@lo:101: Request processed in 188us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.717619:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788650999.717682:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235776:0@lo:101: 00010000:00010000:1.0:1788650999.717695:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.717714:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650999.717762:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235904:0@lo:256: 00000100:00100000:1.0:1788650999.717793:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650999.717858:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.717892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408235904 00000100:00100000:0.0:1788650999.717897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408235904 00000100:00100000:0.0:1788650999.717918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788650999.717923:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408235904:12345-0@lo:256: 20000000:01000000:0.0:1788650999.717937:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788650999.717952:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788650999.717955:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788650999.718040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408235904:12345-0@lo:256: Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.718053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788650999.718182:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408235904:0@lo:256: 10000000:01000000:1.0:1788650999.718218:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788650999.718224:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.718240:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788650999.718247:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788650999.718249:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788650999.718251:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788650999.718267:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.718281:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788650999.718288:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788650999.718298:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408236032:0@lo:101: 00000100:00100000:1.0:1788650999.718325:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650999.718344:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.718463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236032 00000100:00100000:0.0:1788650999.718467:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236032 00000100:00100000:0.0:1788650999.718493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788650999.718500:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408236032:12345-0@lo:101: 00010000:00010000:0.0:1788650999.718507:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788650999.718515:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977197 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.718530:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977197 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.718537:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977197 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.718544:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40031600, rc 0) 00000100:00100000:0.0:1788650999.718578:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408236032:12345-0@lo:101: Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.718583:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788650999.718691:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408236032:0@lo:101: 00010000:00010000:2.0:1788650999.718712:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650999.718720:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788650999.718836:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408236160:0@lo:501: 00000100:00100000:2.0:1788650999.718862:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.718884:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788650999.720639:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236160 00000100:00100000:2.0:1788650999.720651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236160 00000100:00100000:2.0:1788650999.720692:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788650999.720715:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408236160:12345-0@lo:501: 00000100:00100000:2.0:1788650999.720976:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408236160:12345-0@lo:501: Request processed in 264us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.720984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788650999.721040:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408236160:0@lo:501: 00000100:00100000:2.0:1788650999.721082:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408236288:0@lo:503: 00000100:00100000:2.0:1788650999.721140:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.721159:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788650999.721171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236288 00000100:00100000:2.0:1788650999.721174:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236288 00000100:00100000:2.0:1788650999.721191:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788650999.721196:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408236288:12345-0@lo:503: 00000100:00100000:2.0:1788650999.722887:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408236288:12345-0@lo:503: Request processed in 1682us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.722898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788650999.722952:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408236288:0@lo:503: 00000100:00100000:2.0:1788650999.723564:0:8011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8011:1875536408236416:0@lo:502: 00000100:00100000:2.0:1788650999.723614:0:8011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.724651:0:8011:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788650999.726279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236416 00000100:00100000:2.0:1788650999.726290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236416 00000100:00100000:0.0:1788650999.731281:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788650999.731299:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8011:x1875536408236416:12345-0@lo:502: 00000100:00100000:0.0:1788650999.731753:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8011:x1875536408236416:12345-0@lo:502: Request processed in 460us (8138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.731761:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788650999.731990:0:8011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8011:1875536408236416:0@lo:502: 00000020:01000000:2.0:1788650999.732144:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788650999.732152:0:8011:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788650999.732159:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788650999.732167:0:8011:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788650999.732173:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788650999.732177:0:8011:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:2.0:1788650999.732197:0:8011:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788650999.732200:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788650999.732225:0:8011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93be7bba4d40) 00000020:00000080:2.0:1788650999.732368:0:8011:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788650999.732375:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788650999.732451:0:8011:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788650999.732461:0:8011:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788650999.732468:0:8011:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba8879771ac 00010000:00080000:2.0:1788650999.732566:0:8011:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be502ea800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1788650999.732808:0:8011:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788650999.733346:0:8011:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788650999.733359:0:8011:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788650999.733964:0:8011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788650999.734708:0:8011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788650999.734762:0:8011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788650999.734818:0:8011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788650999.737595:0:8013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788650999.737603:0:8013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788650999.744783:0:8011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788650999.744798:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788650999.744837:0:8011:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788650999.744877:0:8011:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879771b3 00000100:00080000:2.0:1788650999.744890:0:8011:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788650999.744895:0:8011:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93be502ea800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1788650999.744930:0:8011:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be6cf4fb80 x1875536408236544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788650999.744962:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408236544:0@lo:8: 00000100:00100000:2.0:1788650999.745090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.745174:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236544 00000100:00100000:2.0:1788650999.745186:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236544 00000100:00100000:2.0:1788650999.745216:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788650999.745222:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875536408236544:12345-0@lo:8: 00010000:00080000:2.0:1788650999.745309:0:6675:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1788650999.745331:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879771ba 00002000:00100000:2.0:1788650999.745344:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93be45b1d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788650999.745348:0:6675:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788650999.745351:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788650999.745473:0:6675:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788650999.745683:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788650999.745713:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93be45b19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788650999.745766:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875536408236544:12345-0@lo:8: Request processed in 542us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.745774:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788650999.745814:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4fb80 x1875536408236544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650999.745825:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788650999.745832:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788650999.745838:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788650999.745843:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788650999.745845:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be502ea800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788650999.745859:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788650999.745863:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408236544:0@lo:8: 00000100:00080000:2.0:1788650999.745882:0:8011:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788650999.745955:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408236672:0@lo:400: 00000100:00100000:2.0:1788650999.745982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788650999.746142:0:8013:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788650999.746252:0:8013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203806143928ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788650999.746646:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788650999.746655:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408237056:0@lo:400: 00000100:00100000:2.0:1788650999.746686:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.746729:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408236800:0@lo:400: 00000100:00100000:2.0:1788650999.746753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.746771:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788650999.746776:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408236928:0@lo:400: 00000100:00100000:2.0:1788650999.746797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788650999.746827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236672 00000100:00100000:2.0:1788650999.746832:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236672 00000100:00100000:2.0:1788650999.746864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237056 00000100:00100000:2.0:1788650999.746867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237056 00000100:00100000:2.0:1788650999.746882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236800 00000100:00100000:2.0:1788650999.746885:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236800 00000100:00100000:2.0:1788650999.746898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788650999.746905:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408236672:12345-0@lo:400: 00000100:00100000:2.0:1788650999.746944:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408236672:12345-0@lo:400: Request processed in 40us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.746951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788650999.746964:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788650999.746969:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408237056:12345-0@lo:400: 00000100:00100000:2.0:1788650999.746994:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408237056:12345-0@lo:400: Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.747000:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788650999.748594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788650999.748608:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408236800:12345-0@lo:400: 00000100:00100000:2.0:1788650999.748677:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408236800:12345-0@lo:400: Request processed in 73us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.748689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788650999.748734:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408236928 00000100:00100000:2.0:1788650999.748741:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408236928 00000100:00100000:2.0:1788650999.748770:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788650999.748777:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408236928:12345-0@lo:400: 00000100:00100000:2.0:1788650999.748807:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408236928:12345-0@lo:400: Request processed in 31us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.748813:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788650999.748856:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4ed80 x1875536408237056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650999.748869:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408237056:0@lo:400: 00010000:00080000:2.0:1788650999.748882:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4fb80 x1875536408236672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650999.748889:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408236672:0@lo:400: 00000020:01000000:3.0:1788650999.749469:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788650999.749476:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650999.749478:0:8011:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788650999.749481:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788650999.749485:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650999.749487:0:8011:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788650999.749490:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788650999.749492:0:8011:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788650999.749532:0:8011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8011:1875536408237184:0@lo:502: 00000100:00100000:3.0:1788650999.749602:0:8011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.749632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237184 00000100:00100000:3.0:1788650999.749637:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237184 00000100:00100000:3.0:1788650999.749666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788650999.749672:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8011:x1875536408237184:12345-0@lo:502: 00000100:00100000:3.0:1788650999.750507:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8011:x1875536408237184:12345-0@lo:502: Request processed in 831us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.750517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788650999.750570:0:8011:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.750596:0:8011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8011:1875536408237184:0@lo:502: 00000020:01000000:3.0:1788650999.750622:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788650999.750627:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788650999.750629:0:8011:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788650999.750632:0:8011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788650999.750686:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788650999.750713:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788650999.750723:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.751214:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788650999.751228:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788650999.751231:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93be45690000 from 1 10000000:01000000:3.0:1788650999.751234:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788650999.751265:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.751274:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.751288:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788650999.751307:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408237312:0@lo:101: 00000100:00100000:3.0:1788650999.751493:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.751521:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07cc0 going to sleep for 11 seconds 00010000:00080000:2.0:1788650999.754180:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4d180 x1875536408236928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650999.754198:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408236928:0@lo:400: 00010000:00080000:2.0:1788650999.754213:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4e680 x1875536408236800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650999.754222:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408236800:0@lo:400: 00000100:00100000:2.0:1788650999.754468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237312 00000100:00100000:2.0:1788650999.754476:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237312 00000100:00100000:2.0:1788650999.754980:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788650999.754990:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408237312:12345-0@lo:101: 00010000:00010000:2.0:1788650999.755086:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788650999.755141:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879771c1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650999.755168:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650999.755180:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788650999.755190:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821ccc00, rc 0) 00000100:00100000:2.0:1788650999.756222:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408237312:12345-0@lo:101: Request processed in 1230us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788650999.756241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788650999.759782:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408237312:0@lo:101: 00010000:00010000:0.0:1788650999.759811:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788650999.759826:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788650999.759908:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408237440:0@lo:501: 00000100:00100000:0.0:1788650999.759969:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.760003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237440 00000100:00100000:3.0:1788650999.760011:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237440 00000100:00100000:0.0:1788650999.760019:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.760077:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788650999.760087:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408237440:12345-0@lo:501: 00000100:00100000:3.0:1788650999.760339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408237440:12345-0@lo:501: Request processed in 251us (367us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788650999.760348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788650999.760401:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408237440:0@lo:501: 10000000:01000000:3.0:1788650999.760440:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788650999.760449:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788650999.760458:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788650999.793912:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788650999.851780:0:8015:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788650999.851815:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408237696:0@lo:7: 00000100:00100000:3.0:1788650999.851891:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.851941:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07000 going to sleep for 11 seconds 00000100:00100000:3.0:1788650999.851971:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788650999.851985:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be758c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408237568:0@lo:13: 00000100:00100000:3.0:1788650999.852014:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788650999.852047:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237696 00000100:00100000:3.0:1788650999.852055:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237696 00000100:00100000:3.0:1788650999.852145:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788650999.852158:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8015:x1875536408237696:12345-0@lo:7: 00000100:00080000:0.0:1788650999.852177:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788650999.855778:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237568 00000100:00100000:1.0:1788650999.855791:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237568 00000100:00100000:1.0:1788650999.855853:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788650999.855864:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875536408237568:12345-0@lo:13: 00002000:00000024:1.0:1788650999.855923:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788650999.856014:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875536408237568:12345-0@lo:13: Request processed in 141us (3987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788650999.856024:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788650999.856172:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be758c1880 x1875536408237568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650999.856197:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408237568:0@lo:13: 00002000:00080000:3.0:1788650999.862599:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788650999.862606:0:6674:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788650999.862694:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8015:x1875536408237696:12345-0@lo:7: Request processed in 10537us (10800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788650999.862720:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788650999.864633:0:8015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be758c0000 x1875536408237696/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788651015 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650999.864652:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be758c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408237696:0@lo:7: 00000004:00080000:1.0:1788650999.864666:0:8015:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788650999.864722:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408237824:0@lo:5: 00000100:00100000:1.0:1788650999.864777:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788650999.864838:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788650999.865184:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237824 00000100:00100000:2.0:1788650999.865191:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237824 00000100:00100000:2.0:1788650999.865243:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788650999.865253:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8015:x1875536408237824:12345-0@lo:5: 00002000:00080000:2.0:1788650999.865431:0:6675:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788650999.865437:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788650999.865861:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8015:x1875536408237824:12345-0@lo:5: Request processed in 605us (1080us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788650999.865868:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788650999.870692:0:8015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7bf0df80 x1875536408237824/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651015 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788650999.870725:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bf0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408237824:0@lo:5: 00000004:00080000:1.0:1788650999.870741:0:8015:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788650999.871054:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408237952:0@lo:700: 00000100:00100000:0.0:1788650999.871137:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.871182:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.871201:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408237952 00000100:00100000:0.0:1788650999.871207:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408237952 00000100:00100000:0.0:1788650999.871252:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788650999.871261:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8015:x1875536408237952:12345-0@lo:700: 00000100:00100000:0.0:1788650999.871307:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1875536408238080:0@lo:700: 00000100:00100000:0.0:1788650999.871353:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788650999.871377:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441af3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788650999.871396:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238080 00000100:00100000:0.0:1788650999.871400:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238080 00000100:00100000:0.0:1788650999.871427:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788650999.871434:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1875536408238080:12345-0@lo:700: 40000000:02000000:0.0:1788650999.946396:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788650999.954079:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1875536408238080:12345-0@lo:700: Request processed in 82637us (82718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788650999.954094:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788650999.954869:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be45a79180 x1875536408238080/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788651015 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788650999.954886:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1875536408238080:0@lo:700: 40000000:02000000:2.0:1788650999.954901:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788651000.044809:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788651000.044828:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788651000.044968:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8015:x1875536408237952:12345-0@lo:700: Request processed in 173704us (173828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651000.044985:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788651000.045078:0:8015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be45a7b480 x1875536408237952/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788651015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651000.045089:0:8015:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788651000.045133:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408237952:0@lo:700: 00000004:02000040:2.0:1788651000.078720:0:8015:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788651000.084832:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408238208:0@lo:5: 00000100:00100000:2.0:1788651000.084900:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651000.084936:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238208 00000100:00100000:3.0:1788651000.084945:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238208 00000100:00100000:2.0:1788651000.084951:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788651000.085001:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651000.085019:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8015:x1875536408238208:12345-0@lo:5: 00002000:00080000:3.0:1788651000.092689:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788651000.092721:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788651000.101724:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8015:x1875536408238208:12345-0@lo:5: Request processed in 16707us (16816us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788651000.101737:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788651000.101807:0:8015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4e680 x1875536408238208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651016 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651000.101825:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8015:1875536408238208:0@lo:5: 00000004:00080000:2.0:1788651000.101840:0:8015:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788651000.132667:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651001.156903:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651001.735872:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408238336:0@lo:13: 00000100:00100000:2.0:1788651001.735937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651001.741679:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238336 00000100:00100000:2.0:1788651001.741702:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238336 00000100:00100000:2.0:1788651001.741775:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651001.741785:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408238336:12345-0@lo:13: 00002000:00000024:2.0:1788651001.741820:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651001.741893:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408238336:12345-0@lo:13: Request processed in 110us (5955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651001.741900:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788651001.741944:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be45a78a80 x1875536408238336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651001.741976:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408238336:0@lo:13: 00000100:00080000:1.0:1788651001.742090:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651002.185954:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651003.204327:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788651003.849175:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788651004.228316:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651004.329547:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.334808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389341312 00000100:00100000:2.0:1788651004.334827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389341312 00000100:00100000:2.0:1788651004.334896:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:2.0:1788651004.334907:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1875536389341312:12345-192.168.203.21@tcp:250: 00010000:00080000:2.0:1788651004.334941:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 674ed5c9-3ef5-41ff-ae15-73527c65e0c3@192.168.203.21@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788651004.334976:0:5833:0:(genops.c:1385:class_connect()) connect: client 674ed5c9-3ef5-41ff-ae15-73527c65e0c3, cookie 0x84a2fba8879771cf 00000100:00080000:2.0:1788651004.335188:0:5833:0:(import.c:65:import_set_state_nolock()) ffff93be45b1a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651004.335287:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+5:2352:x1875536389341312:12345-192.168.203.21@tcp:250: Request processed in 379us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.335294:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:3.0:1788651004.344743:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651004.344833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389341440 00000100:00100000:1.0:1788651004.344847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389341440 00000100:00100000:1.0:1788651004.344931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:1.0:1788651004.344944:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+5:5579:x1875536389341440:12345-192.168.203.21@tcp:101: 00010000:00010000:1.0:1788651004.344966:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651004.344989:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf13 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.345026:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.345041:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.345052:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670200, rc 0) 00000100:00100000:1.0:1788651004.345165:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+6:5579:x1875536389341440:12345-192.168.203.21@tcp:101: Request processed in 223us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.345173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:1.0:1788651004.352007:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.352067:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389341568 00000100:00100000:2.0:1788651004.352080:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389341568 00000100:00100000:2.0:1788651004.352174:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:2.0:1788651004.352186:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+6:5579:x1875536389341568:12345-192.168.203.21@tcp:501: 00000100:00100000:2.0:1788651004.352586:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+6:5579:x1875536389341568:12345-192.168.203.21@tcp:501: Request processed in 399us (641us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788651004.352780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:1.0:1788651004.355168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651004.355266:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389341696 00000100:00100000:3.0:1788651004.355280:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389341696 00000100:00100000:3.0:1788651004.355341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:3.0:1788651004.355353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+6:5579:x1875536389341696:12345-192.168.203.21@tcp:101: 00010000:00010000:3.0:1788651004.355371:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651004.355395:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651004.355429:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651004.355444:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651004.355455:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cb200, rc 0) 00000100:00100000:3.0:1788651004.355526:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+7:5579:x1875536389341696:12345-192.168.203.21@tcp:101: Request processed in 175us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651004.355555:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:3.0:1788651004.357512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651004.357623:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389341824 00000100:00100000:1.0:1788651004.357637:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389341824 00000100:00100000:1.0:1788651004.357740:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:1.0:1788651004.357752:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+7:5579:x1875536389341824:12345-192.168.203.21@tcp:501: 00000100:00100000:1.0:1788651004.358367:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5579:x1875536389341824:12345-192.168.203.21@tcp:501: Request processed in 615us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.358377:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:1.0:1788651004.366601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651004.366697:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389341952 00000100:00100000:3.0:1788651004.366708:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389341952 00000100:00100000:3.0:1788651004.366777:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1788651004.366788:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5579:x1875536389341952:12345-192.168.203.21@tcp:503: 00000100:00100000:3.0:1788651004.367389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5579:x1875536389341952:12345-192.168.203.21@tcp:503: Request processed in 598us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651004.367400:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:2.0:1788651004.370537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651004.370772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342080 00000100:00100000:1.0:1788651004.370869:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342080 00000100:00100000:1.0:1788651004.371012:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:1.0:1788651004.371024:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5597:x1875536389342080:12345-192.168.203.21@tcp:502: 00000100:00100000:1.0:1788651004.372062:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5597:x1875536389342080:12345-192.168.203.21@tcp:502: Request processed in 1031us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.372077:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:1.0:1788651004.416301:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651004.416384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342208 00000100:00100000:3.0:1788651004.416398:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342208 00000100:00100000:3.0:1788651004.416499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:3.0:1788651004.416513:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5597:x1875536389342208:12345-192.168.203.21@tcp:502: 00000100:00100000:3.0:1788651004.416861:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5597:x1875536389342208:12345-192.168.203.21@tcp:502: Request processed in 350us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651004.416871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:2.0:1788651004.433716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651004.433993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342336 00000100:00100000:1.0:1788651004.434007:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342336 00000100:00100000:1.0:1788651004.434078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:1.0:1788651004.434091:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5579:x1875536389342336:12345-192.168.203.21@tcp:101: 00010000:00010000:1.0:1788651004.434139:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651004.434176:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be41670c00/0x84a2fba8879771e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf44 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.434214:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be41670c00/0x84a2fba8879771e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf44 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.434227:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be41670c00/0x84a2fba8879771e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf44 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.434237:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670c00, rc 0) 00000100:00100000:1.0:1788651004.434306:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5579:x1875536389342336:12345-192.168.203.21@tcp:101: Request processed in 218us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.434312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:3.0:1788651004.440836:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.440989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342464 00000100:00100000:2.0:1788651004.441002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342464 00000100:00100000:2.0:1788651004.441060:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:2.0:1788651004.441072:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5579:x1875536389342464:12345-192.168.203.21@tcp:256: 20000000:01000000:2.0:1788651004.441141:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788651004.441161:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788651004.441166:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788651004.441169:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788651004.441172:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788651004.443781:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5579:x1875536389342464:12345-192.168.203.21@tcp:256: Request processed in 2693us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.443799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:2.0:1788651004.447232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651004.447324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342592 00000100:00100000:1.0:1788651004.447337:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342592 00000100:00100000:1.0:1788651004.447407:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:1.0:1788651004.447418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5579:x1875536389342592:12345-192.168.203.21@tcp:101: 00010000:00010000:1.0:1788651004.447440:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651004.447559:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.447599:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.447614:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651004.447649:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9dc00, rc 0) 00000100:00100000:1.0:1788651004.448152:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5579:x1875536389342592:12345-192.168.203.21@tcp:101: Request processed in 733us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.448161:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:1.0:1788651004.455796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.458245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342720 00000100:00100000:2.0:1788651004.458266:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342720 00000100:00100000:2.0:1788651004.458336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:2.0:1788651004.458350:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5579:x1875536389342720:12345-192.168.203.21@tcp:501: 00000100:00100000:2.0:1788651004.458726:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5579:x1875536389342720:12345-192.168.203.21@tcp:501: Request processed in 378us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.458736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:3.0:1788651004.462062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.462266:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342848 00000100:00100000:2.0:1788651004.462281:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342848 00000100:00100000:2.0:1788651004.462352:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:2.0:1788651004.462365:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5579:x1875536389342848:12345-192.168.203.21@tcp:503: 00000100:00100000:2.0:1788651004.463083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5579:x1875536389342848:12345-192.168.203.21@tcp:503: Request processed in 716us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.463095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:2.0:1788651004.472255:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.472310:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389342976 00000100:00100000:2.0:1788651004.472323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389342976 00000100:00100000:2.0:1788651004.472392:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:2.0:1788651004.472405:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5603:x1875536389342976:12345-192.168.203.21@tcp:502: 00000100:00100000:2.0:1788651004.472964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5603:x1875536389342976:12345-192.168.203.21@tcp:502: Request processed in 558us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.472983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:2.0:1788651004.479227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651004.479269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343104 00000100:00100000:2.0:1788651004.479282:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343104 00000100:00100000:2.0:1788651004.479341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:2.0:1788651004.479352:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5603:x1875536389343104:12345-192.168.203.21@tcp:502: 00000100:00100000:2.0:1788651004.479701:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5603:x1875536389343104:12345-192.168.203.21@tcp:502: Request processed in 349us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.479710:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:0.0:1788651004.485551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651004.486211:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343232 00000100:00100000:1.0:1788651004.486227:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343232 00000100:00100000:1.0:1788651004.486299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1788651004.486310:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875536389343232:12345-192.168.203.21@tcp:38: 00010000:00080000:1.0:1788651004.486350:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788651004.486415:0:5842:0:(genops.c:1385:class_connect()) connect: client f051ebe0-0677-425e-9b9b-54befcd9fd1c, cookie 0x84a2fba8879771f2 00000004:00100000:1.0:1788651004.486464:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788651004.486474:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788651004.544754:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651004.544865:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2352:x1875536389343232:12345-192.168.203.21@tcp:38: Request processed in 58554us (59328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651004.544879:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1788651004.804932:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651004.806084:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408238720:0@lo:400: 00000100:00100000:0.0:1788651004.806206:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651004.806279:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651004.806285:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408238592:0@lo:400: 00000100:00100000:0.0:1788651004.806305:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651004.809008:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408238848:0@lo:400: 00000100:00100000:3.0:1788651004.809127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651004.809196:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408238464:0@lo:400: 00000100:00100000:3.0:1788651004.809259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651004.809425:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238720 00000100:00100000:3.0:1788651004.809436:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238720 00000100:00100000:3.0:1788651004.809522:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238592 00000100:00100000:3.0:1788651004.809526:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238592 00000100:00100000:3.0:1788651004.809548:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788651004.809556:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408238720:12345-0@lo:400: 00000100:00100000:3.0:1788651004.809616:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408238720:12345-0@lo:400: Request processed in 61us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651004.809623:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788651004.809639:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788651004.809645:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408238592:12345-0@lo:400: 00000100:00100000:3.0:1788651004.809680:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408238592:12345-0@lo:400: Request processed in 36us (3374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651004.809686:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788651004.809728:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4e300 x1875536408238592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651004.809744:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408238592:0@lo:400: 00010000:00080000:3.0:1788651004.809762:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4f800 x1875536408238720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651004.809770:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408238720:0@lo:400: 00000100:00080000:3.0:1788651004.809815:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651004.810176:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238848 00000100:00100000:0.0:1788651004.810182:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238848 00000100:00100000:0.0:1788651004.810235:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651004.810243:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408238848:12345-0@lo:400: 00000100:00100000:0.0:1788651004.810289:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408238848:12345-0@lo:400: Request processed in 47us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651004.810295:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788651004.811697:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651004.811722:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408239104:0@lo:400: 00000100:00100000:2.0:1788651004.811794:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651004.811868:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239104 00000100:00100000:2.0:1788651004.811876:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239104 00000100:00100000:2.0:1788651004.811936:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651004.811946:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408239104:12345-0@lo:400: 00000100:00100000:2.0:1788651004.812155:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408239104:12345-0@lo:400: Request processed in 210us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.812164:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788651004.812210:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3aa00 x1875536408239104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651004.812223:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788651004.812242:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408239104:0@lo:400: 00000100:00080000:3.0:1788651004.812377:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651004.812382:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788651004.812414:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3a680 x1875536408238848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651004.812425:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408238848:0@lo:400: 00000100:00100000:3.0:1788651004.812435:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651004.812443:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408238976:0@lo:400: 00000100:00100000:3.0:1788651004.812505:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651004.812729:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238976 00000100:00100000:2.0:1788651004.812735:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238976 00000100:00100000:2.0:1788651004.812841:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651004.812850:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408238976:12345-0@lo:400: 00000100:00100000:2.0:1788651004.812897:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408238976:12345-0@lo:400: Request processed in 48us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651004.812903:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788651004.812977:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408238464 00000100:00100000:1.0:1788651004.812983:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408238464 00000100:00080000:3.0:1788651004.815447:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651004.815537:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe38a80 x1875536408238976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651004.815558:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408238976:0@lo:400: 00000100:00100000:0.0:1788651004.817736:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788651004.817753:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408238464:12345-0@lo:400: 00000100:00100000:0.0:1788651004.817898:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408238464:12345-0@lo:400: Request processed in 149us (8638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651004.817906:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788651004.819639:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408238464:0@lo:400: 00010000:00010000:1.0:1788651005.252400:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651005.318242:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651005.318279:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408239232:0@lo:13: 00000100:00100000:1.0:1788651005.318373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651005.318519:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239232 00000100:00100000:2.0:1788651005.318529:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239232 00000100:00100000:2.0:1788651005.318595:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651005.318608:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408239232:12345-0@lo:13: 00002000:00000024:2.0:1788651005.318668:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651005.318729:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408239232:12345-0@lo:13: Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651005.318737:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788651005.319936:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3aa00 x1875536408239232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651005.319968:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408239232:0@lo:13: 00000100:00100000:2.0:1788651005.555624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651005.556061:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343488 00000100:00100000:3.0:1788651005.556076:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343488 00000100:00100000:3.0:1788651005.556246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1788651005.556259:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5579:x1875536389343488:12345-192.168.203.21@tcp:41: 00000100:00080000:1.0:1788651005.556494:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788651005.556826:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788651005.556942:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5579:x1875536389343488:12345-192.168.203.21@tcp:41: Request processed in 684us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651005.556952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1788651005.562538:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651005.567150:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343360 00000100:00100000:0.0:1788651005.567174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343360 00000100:00100000:0.0:1788651005.567430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1788651005.567445:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:0:x1875536389343360:12345-192.168.203.21@tcp:41: 00000004:00000024:0.0:1788651005.567489:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788651005.571329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:0:x1875536389343360:12345-192.168.203.21@tcp:41: Request processed in 3865us (8784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651005.571351:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:2.0:1788651005.574197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651005.579550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343616 00000100:00100000:0.0:1788651005.579572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343616 00000100:00100000:1.0:1788651005.585692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1788651005.585714:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5579:x1875536389343616:12345-192.168.203.21@tcp:40: 00000100:00100000:1.0:1788651005.586555:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5579:x1875536389343616:12345-192.168.203.21@tcp:40: Request processed in 844us (12369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651005.586566:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1788651005.590266:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651005.590329:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651005.590350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651005.590400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651005.590471:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343744 00000100:00100000:1.0:1788651005.590486:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343744 00000100:00100000:1.0:1788651005.590552:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389343872 00000100:00100000:1.0:1788651005.590556:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389343872 00000100:00100000:2.0:1788651005.590591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344000 00000100:00100000:2.0:1788651005.590597:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344000 00000100:00100000:2.0:1788651005.590646:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:2.0:1788651005.590669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389344000:12345-192.168.203.21@tcp:400: 00000100:00100000:2.0:1788651005.590765:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389344000:12345-192.168.203.21@tcp:400: Request processed in 108us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651005.590774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:2.0:1788651005.590819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344128 00000100:00100000:2.0:1788651005.590823:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344128 00000100:00100000:2.0:1788651005.590849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:2.0:1788651005.590856:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5579:x1875536389344128:12345-192.168.203.21@tcp:33: 00000100:00100000:0.0:1788651005.591172:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1788651005.591180:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389343744:12345-192.168.203.21@tcp:8: 00010000:00080000:0.0:1788651005.591209:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1788651005.591248:0:6672:0:(genops.c:1385:class_connect()) connect: client f051ebe0-0677-425e-9b9b-54befcd9fd1c, cookie 0x84a2fba8879771f9 00002000:00100000:0.0:1788651005.591263:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f051ebe0-0677-425e-9b9b-54befcd9fd1c/ffff93be75631000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651005.591293:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651005.591701:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788651005.591742:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93be75633000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651005.592035:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2352:x1875536389343744:12345-192.168.203.21@tcp:8: Request processed in 852us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651005.592043:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1788651005.592067:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1788651005.592073:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389343872:12345-192.168.203.21@tcp:8: 00010000:00080000:0.0:1788651005.592093:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1788651005.592197:0:6672:0:(genops.c:1385:class_connect()) connect: client f051ebe0-0677-425e-9b9b-54befcd9fd1c, cookie 0x84a2fba887977200 00002000:00100000:0.0:1788651005.592207:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f051ebe0-0677-425e-9b9b-54befcd9fd1c/ffff93be75635000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651005.592231:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651005.592510:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788651005.592532:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93be75634800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651005.592564:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2352:x1875536389343872:12345-192.168.203.21@tcp:8: Request processed in 489us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651005.592572:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000004:00080000:2.0:1788651005.640016:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 49085us 00000004:00200000:2.0:1788651005.680673:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788651005.683343:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5579:x1875536389344128:12345-192.168.203.21@tcp:33: Request processed in 92470us (92924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651005.683361:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:2.0:1788651005.945711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651005.946015:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344256 00000100:00100000:3.0:1788651005.946029:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344256 00000100:00100000:3.0:1788651005.946162:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1788651005.946176:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5620:x1875536389344256:12345-192.168.203.21@tcp:101: 00010000:00010000:3.0:1788651005.946201:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651005.948442:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cac00/0x84a2fba887977207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf75 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651005.948531:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797720e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651005.948545:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797720e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651005.948560:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797720e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651005.949540:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788651005.949547:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651005.949571:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797720e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651005.949605:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cac00/0x84a2fba887977207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf75 expref: 8 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651005.949627:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797720e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf75 expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651005.950474:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759d00) 00010000:00010000:3.0:1788651005.950479:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651005.950483:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429ca600, rc 0) 00000100:00100000:3.0:1788651005.950785:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:5620:x1875536389344256:12345-192.168.203.21@tcp:101: Request processed in 4465us (4942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651005.950796:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:0.0:1788651006.276251:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651006.852512:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408239360:0@lo:13: 00000100:00100000:1.0:1788651006.852583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651006.852707:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239360 00000100:00100000:2.0:1788651006.852715:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239360 00000100:00100000:2.0:1788651006.852783:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651006.852793:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408239360:12345-0@lo:13: 00002000:00000024:2.0:1788651006.852813:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788651006.852888:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651006.852986:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408239360:12345-0@lo:13: Request processed in 194us (401us total) trans 0 rc 0/0 00010000:00080000:1.0:1788651006.852991:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be45a7b800 x1875536408239360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651006.852993:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651006.853007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408239360:0@lo:13: 00010000:00010000:1.0:1788651007.300332:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651007.921363:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651007.921601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344384 00000100:00100000:1.0:1788651007.921611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344384 00000100:00100000:1.0:1788651007.921706:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1788651007.921719:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:5672:x1875536389344384:12345-192.168.203.21@tcp:41: 00000004:00000024:1.0:1788651007.921774:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788651007.921861:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:5672:x1875536389344384:12345-192.168.203.21@tcp:41: Request processed in 146us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651007.921869:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00080000:3.0:1788651007.923712:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651007.924989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651007.925222:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344512 00000100:00100000:3.0:1788651007.925231:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344512 00000100:00100000:3.0:1788651007.925362:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1788651007.925375:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5672:x1875536389344512:12345-192.168.203.21@tcp:13: 00002000:00000024:3.0:1788651007.925411:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651007.925478:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5672:x1875536389344512:12345-192.168.203.21@tcp:13: Request processed in 107us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651007.925485:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00080000:1.0:1788651007.927042:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651007.938874:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651007.943647:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344640 00000100:00100000:0.0:1788651007.943662:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344640 00000100:00100000:0.0:1788651007.943866:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1788651007.943878:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5672:x1875536389344640:12345-192.168.203.21@tcp:13: 00002000:00000024:0.0:1788651007.943919:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651007.943989:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:5672:x1875536389344640:12345-192.168.203.21@tcp:13: Request processed in 113us (5124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651007.943997:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00080000:3.0:1788651007.945661:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788651008.324254:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788651008.965826:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00010000:00010000:1.0:1788651009.348476:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651009.924392:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408239616:0@lo:400: 00000100:00100000:2.0:1788651009.924467:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651009.924518:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408240128:0@lo:400: 00000100:00100000:2.0:1788651009.924542:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651009.924574:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651009.924581:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408239744:0@lo:400: 00000100:00100000:2.0:1788651009.924604:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651009.924648:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239616 00000100:00100000:2.0:1788651009.924655:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239616 00000100:00100000:2.0:1788651009.924706:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239744 00000100:00100000:2.0:1788651009.924709:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239744 00000100:00100000:2.0:1788651009.924749:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651009.924759:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408239616:12345-0@lo:400: 00000100:00100000:2.0:1788651009.924819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408239616:12345-0@lo:400: Request processed in 61us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651009.924826:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651009.924842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788651009.924849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408239744:12345-0@lo:400: 00000100:00100000:2.0:1788651009.924880:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408239744:12345-0@lo:400: Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651009.924887:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788651009.924910:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408240128 00000100:00100000:2.0:1788651009.924914:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408240128 00000100:00080000:0.0:1788651009.924955:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651009.924957:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788651009.924962:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651009.924967:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408240128:12345-0@lo:400: 00000100:00100000:2.0:1788651009.925005:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408240128:12345-0@lo:400: Request processed in 39us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651009.925013:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788651009.925020:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408239872:0@lo:400: 00000100:00100000:0.0:1788651009.925065:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651009.925093:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408239744:0@lo:400: 00000100:00100000:0.0:1788651009.925097:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788651009.925133:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408239488:0@lo:400: 00000100:00100000:2.0:1788651009.925138:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408239616:0@lo:400: 00010000:00080000:2.0:1788651009.925156:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe39c00 x1875536408240128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651009.925173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651009.925183:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408240128:0@lo:400: 00000100:00100000:0.0:1788651009.925214:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408240000:0@lo:400: 00000100:00100000:2.0:1788651009.925230:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239488 00000100:00100000:2.0:1788651009.925234:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239488 00000100:00100000:0.0:1788651009.925243:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651009.925262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788651009.925271:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408239488:12345-0@lo:400: 00000100:00100000:2.0:1788651009.925313:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408239488:12345-0@lo:400: Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651009.925327:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788651009.925357:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408239872 00000100:00100000:2.0:1788651009.925361:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408239872 00000100:00100000:2.0:1788651009.925392:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651009.925400:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408239872:12345-0@lo:400: 00000100:00100000:2.0:1788651009.925436:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408239872:12345-0@lo:400: Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651009.925442:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788651009.925465:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651009.925488:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408239488:0@lo:400: 00010000:00080000:2.0:1788651009.925501:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe38380 x1875536408239872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651009.925509:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408239872:0@lo:400: 00000100:00100000:2.0:1788651009.925538:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408240000 00000100:00100000:2.0:1788651009.925542:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408240000 00000100:00100000:2.0:1788651009.925578:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788651009.925586:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408240000:12345-0@lo:400: 00000100:00100000:2.0:1788651009.925639:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408240000:12345-0@lo:400: Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651009.925646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788651009.925665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651009.925687:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408240000:0@lo:400: 00000001:00100000:2.0:1788651009.979054:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000001:00100000:2.0:1788651009.985881:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00010000:00010000:0.0:1788651010.373431:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788651010.422089:0:8283:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788651010.437984:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651010.438016:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408240256:0@lo:13: 00000100:00100000:2.0:1788651010.438078:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651010.438237:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408240256 00000100:00100000:2.0:1788651010.438245:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408240256 00000100:00100000:2.0:1788651010.438297:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788651010.438307:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408240256:12345-0@lo:13: 00002000:00000024:2.0:1788651010.438341:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651010.438403:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408240256:12345-0@lo:13: Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651010.438410:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788651010.438535:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe39500 x1875536408240256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651010.438554:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408240256:0@lo:13: 00000100:00100000:0.0:1788651011.040666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651011.040711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651011.040749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651011.040780:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651011.040823:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345024 00000100:00100000:0.0:1788651011.040832:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345024 00000100:00100000:0.0:1788651011.040897:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345152 00000100:00100000:0.0:1788651011.040900:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345152 00000100:00100000:0.0:1788651011.040917:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1788651011.040936:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2353:x1875536389345024:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1788651011.041007:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2353:x1875536389345024:12345-192.168.203.21@tcp:400: Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651011.041014:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1788651011.041028:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1788651011.041034:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389345152:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1788651011.041070:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389345152:12345-192.168.203.21@tcp:400: Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651011.041076:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00080000:0.0:1788651011.041091:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651011.041094:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651011.041282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344768 00000100:00100000:1.0:1788651011.041286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344768 00000100:00100000:1.0:1788651011.041321:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:1.0:1788651011.041329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389344768:12345-192.168.203.21@tcp:400: 00000100:00100000:1.0:1788651011.041359:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389344768:12345-192.168.203.21@tcp:400: Request processed in 31us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651011.041366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:3.0:1788651011.042033:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389344896 00000100:00100000:3.0:1788651011.042052:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389344896 00000100:00100000:3.0:1788651011.042133:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:3.0:1788651011.042142:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389344896:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1788651011.042196:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389344896:12345-192.168.203.21@tcp:400: Request processed in 56us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651011.042203:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00080000:0.0:1788651011.042732:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651011.397341:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651011.976079:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408240384:0@lo:13: 00000100:00100000:2.0:1788651011.976199:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651011.976320:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408240384 00000100:00100000:3.0:1788651011.976330:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408240384 00000100:00100000:3.0:1788651011.976408:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788651011.976420:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408240384:12345-0@lo:13: 00002000:00000024:3.0:1788651011.976465:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788651011.977853:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651011.982924:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408240384:12345-0@lo:13: Request processed in 6490us (6708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651011.982943:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788651011.983359:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be45a78000 x1875536408240384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651011.983391:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408240384:0@lo:13: 00010000:00010000:0.0:1788651012.421205:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651013.444539:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788651013.811770:0:8431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe87939a20 20000000:00000080:0.0:1788651013.811789:0:8431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93be74fc2c00 uarg=0000000000000000 20000000:01000000:0.0:1788651013.811954:0:8431:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788651013.811957:0:8431:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788651013.811965:0:8431:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788651013.811970:0:8431:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788651013.811975:0:8431:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788651013.811990:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788651013.811992:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788651013.812412:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788651013.812415:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651013.813528:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788651013.814360:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788651013.814431:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788651013.814465:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788651013.814478:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788651013.814480:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651013.815439:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788651013.816063:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788651013.816151:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788651013.816189:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788651013.816204:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788651013.816206:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651013.817410:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788651013.818060:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788651013.818259:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788651013.818304:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788651013.818319:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788651013.818321:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651013.819343:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788651013.819974:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788651013.820028:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788651013.820083:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1788651013.820099:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788651013.820421:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820440:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797710b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820448:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977135 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820464:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797715f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820471:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797716d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820478:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797717b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820485:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977197 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820492:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820502:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820509:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820518:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820557:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820571:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.820686:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240512:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651013.820905:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820916:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 9 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.820925:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240640:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651013.820971:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.820979:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.820990:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240768:0@lo:104: 00000100:00100000:0.0:1788651013.821028:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651013.821061:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977197 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.821069:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977197 expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.821076:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240896:0@lo:104: 00000100:00100000:0.0:1788651013.821097:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651013.821145:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797717b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.821155:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797717b expref: 18 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.821169:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241024:0@lo:104: 00010000:00010000:0.0:1788651013.821194:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797716d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.821202:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797716d expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.821208:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241152:0@lo:104: 00010000:00010000:0.0:1788651013.821229:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797715f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.821236:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797715f expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.821244:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241280:0@lo:104: 00010000:00010000:0.0:1788651013.821268:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977135 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.821276:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977135 expref: 18 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.821283:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241408:0@lo:104: 00010000:00010000:0.0:1788651013.821305:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797710b expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651013.821313:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797710b expref: 18 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.821333:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241536:0@lo:104: 00000100:00100000:0.0:1788651013.821355:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5957bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651013.821435:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788651013.821454:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.821476:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.821488:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.821496:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.821504:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.821511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408240768 00000100:00100000:1.0:1788651013.821518:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408240768 00000100:00100000:1.0:1788651013.821553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408240896 00000100:00100000:1.0:1788651013.821557:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408240896 00000100:00100000:1.0:1788651013.821568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241024 00000100:00100000:1.0:1788651013.821570:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241024 00000100:00100000:1.0:1788651013.821579:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241152 00000100:00100000:1.0:1788651013.821594:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241152 00000100:00100000:1.0:1788651013.821614:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241280 00000100:00100000:1.0:1788651013.821616:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241280 00000100:00100000:1.0:1788651013.821624:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241408 00000100:00100000:1.0:1788651013.821626:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241408 00000100:00100000:1.0:1788651013.821645:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241536 00000100:00100000:1.0:1788651013.821648:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241536 00000100:00100000:1.0:1788651013.821659:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651013.821667:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+9:8431:x1875536408240768:12345-0@lo:104: 00010000:00010000:1.0:1788651013.821678:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.821740:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788651013.821746:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+9:8431:x1875536408240768:12345-0@lo:104: Request processed in 80us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.821753:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651013.821777:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651013.821782:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75628c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+8:8431:x1875536408240896:12345-0@lo:104: 00010000:00010000:1.0:1788651013.821789:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.821820:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788651013.821825:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75628c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+8:8431:x1875536408240896:12345-0@lo:104: Request processed in 43us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.821831:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651013.822013:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240768:0@lo:104: 00000100:00100000:0.0:1788651013.822023:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240896:0@lo:104: 00000100:00100000:1.0:1788651013.822082:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651013.822089:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+7:8431:x1875536408241024:12345-0@lo:104: 00010000:00010000:1.0:1788651013.822096:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822172:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788651013.822177:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+7:8431:x1875536408241024:12345-0@lo:104: Request processed in 90us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.822195:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651013.822209:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651013.822214:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+6:8431:x1875536408241152:12345-0@lo:104: 00010000:00010000:1.0:1788651013.822221:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822248:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788651013.822252:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+6:8431:x1875536408241152:12345-0@lo:104: Request processed in 39us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.822258:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651013.822269:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651013.822275:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:8431:x1875536408241280:12345-0@lo:104: 00010000:00010000:1.0:1788651013.822282:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822307:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788651013.822312:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:8431:x1875536408241280:12345-0@lo:104: Request processed in 38us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.822318:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651013.822329:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788651013.822334:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+4:8431:x1875536408241408:12345-0@lo:104: 00010000:00010000:1.0:1788651013.822341:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822367:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788651013.822372:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+4:8431:x1875536408241408:12345-0@lo:104: Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.822383:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788651013.822397:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788651013.822403:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:8431:x1875536408241536:12345-0@lo:104: 00010000:00010000:1.0:1788651013.822411:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822437:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788651013.822441:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:8431:x1875536408241536:12345-0@lo:104: Request processed in 40us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.822446:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788651013.822464:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788651013.822471:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822477:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cb600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.822481:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822489:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.822496:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.822502:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.822531:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822538:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.822565:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.822572:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cb600/0x84a2fba8879771c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879771c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651013.822696:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241024:0@lo:104: 00000100:00100000:0.0:1788651013.822706:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241152:0@lo:104: 00000100:00100000:0.0:1788651013.822713:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241280:0@lo:104: 00000100:00100000:0.0:1788651013.822719:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241408:0@lo:104: 00000100:00100000:0.0:1788651013.822725:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408241536:0@lo:104: 00010000:00010000:3.0:1788651013.822791:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788651013.823078:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788651013.823083:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823090:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40031e00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.823093:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823101:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.823133:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.823138:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.823162:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823167:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.823182:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823189:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be40031e00/0x84a2fba88797717b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977182 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823199:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788651013.823209:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823214:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40030800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.823217:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823224:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.823230:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.823235:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.823249:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823255:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.823260:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823265:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be40030800/0x84a2fba88797716d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977174 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823273:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788651013.823276:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823281:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.823284:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823301:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.823307:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.823312:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.823325:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823331:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.823337:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823342:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41671600/0x84a2fba88797715f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823352:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651013.823355:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823361:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.823363:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823369:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.823375:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.823385:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.823398:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823403:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.823407:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823412:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797713c expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823422:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651013.823424:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823429:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.823432:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823438:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.823444:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.823449:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.823460:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823465:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.823475:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823480:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41671400/0x84a2fba88797710b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977112 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.823490:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651013.823492:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651013.823494:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651013.823510:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408241664:0@lo:103: 00000100:00100000:1.0:1788651013.823556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.823688:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408242176:0@lo:103: 00000100:00100000:1.0:1788651013.823714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.823738:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651013.823744:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408242048:0@lo:103: 00000100:00100000:1.0:1788651013.823764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.823794:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408241792:0@lo:103: 00000100:00100000:1.0:1788651013.823816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.823826:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408242304:0@lo:103: 00000100:00100000:1.0:1788651013.823995:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.824009:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651013.824015:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408241920:0@lo:103: 00000100:00100000:1.0:1788651013.824034:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.824058:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241664 00000100:00100000:1.0:1788651013.824064:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241664 00010000:00010000:1.0:1788651013.824090:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 19 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.824143:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242176 00000100:00100000:1.0:1788651013.824146:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242176 00010000:00010000:1.0:1788651013.824158:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977135 expref: 20 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.824167:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242048 00000100:00100000:1.0:1788651013.824169:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242048 00010000:00010000:1.0:1788651013.824177:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797715f expref: 21 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.824186:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241792 00000100:00100000:1.0:1788651013.824188:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241792 00010000:00010000:1.0:1788651013.824199:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797717b expref: 22 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.824209:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242304 00000100:00100000:1.0:1788651013.824211:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242304 00010000:00010000:1.0:1788651013.824221:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797710b expref: 23 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.824231:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408241920 00000100:00100000:1.0:1788651013.824233:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408241920 00010000:00010000:1.0:1788651013.824244:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797716d expref: 24 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.824256:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651013.824264:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+24:3307:x1875536408241664:12345-0@lo:103: 00010000:00010000:1.0:1788651013.824275:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.824280:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 24 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824299:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 24 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824315:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821ccc00/0x84a2fba8879771c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879771c1 expref: 24 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824329:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.824364:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+23:3307:x1875536408241664:12345-0@lo:103: Request processed in 100us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.824370:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651013.824387:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651013.824393:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+22:3307:x1875536408242176:12345-0@lo:103: 00010000:00010000:1.0:1788651013.824400:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.824405:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977135 expref: 22 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824413:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977135 expref: 22 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824422:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670e00/0x84a2fba88797713c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977135 expref: 22 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824431:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.824451:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+21:3307:x1875536408242176:12345-0@lo:103: Request processed in 58us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.824457:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651013.824469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651013.824474:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3307:x1875536408242048:12345-0@lo:103: 00010000:00010000:1.0:1788651013.824488:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.824492:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797715f expref: 20 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824500:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797715f expref: 20 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824509:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cb800/0x84a2fba887977166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797715f expref: 20 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824518:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.824537:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408242048:12345-0@lo:103: Request processed in 63us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.824542:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651013.824553:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651013.824558:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:3308:x1875536408241792:12345-0@lo:103: 00010000:00010000:1.0:1788651013.824565:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.824569:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797717b expref: 18 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824576:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797717b expref: 18 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824740:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cbc00/0x84a2fba887977182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797717b expref: 18 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824748:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.824820:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:3308:x1875536408241792:12345-0@lo:103: Request processed in 261us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.824834:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651013.824912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651013.824918:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3308:x1875536408242304:12345-0@lo:103: 00010000:00010000:1.0:1788651013.824927:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.824932:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797710b expref: 16 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824939:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797710b expref: 16 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824948:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030a00/0x84a2fba887977112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797710b expref: 16 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.824956:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.824977:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:3308:x1875536408242304:12345-0@lo:103: Request processed in 60us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.824981:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651013.824991:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788651013.824996:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3308:x1875536408241920:12345-0@lo:103: 00010000:00010000:1.0:1788651013.825002:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.825005:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797716d expref: 14 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.825012:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797716d expref: 14 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.825022:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030000/0x84a2fba887977174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797716d expref: 14 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.825040:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.825060:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3308:x1875536408241920:12345-0@lo:103: Request processed in 64us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.825065:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788651013.825102:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408242048:0@lo:103: 00000100:00100000:1.0:1788651013.825127:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408241664:0@lo:103: 00000100:00100000:1.0:1788651013.825133:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408242176:0@lo:103: 00010000:00010000:3.0:1788651013.826224:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651013.826229:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651013.826231:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651013.826268:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826278:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651013.826282:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826292:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651013.826299:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651013.826304:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651013.826345:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826351:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651013.826366:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826385:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41670400/0x84a2fba887977197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797719e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826398:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651013.826400:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651013.826401:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651013.826417:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408242432:0@lo:103: 00000100:00100000:1.0:1788651013.826463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651013.826506:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242432 00000100:00100000:1.0:1788651013.826512:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242432 00010000:00010000:1.0:1788651013.826535:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977197 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.826559:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788651013.826567:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be460a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:3309:x1875536408242432:12345-0@lo:103: 00010000:00010000:1.0:1788651013.826576:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.826802:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977197 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826822:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977197 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826835:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40031600/0x84a2fba88797719e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977197 expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.826964:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.827008:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be460a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:3309:x1875536408242432:12345-0@lo:103: Request processed in 441us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.827024:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788651013.827150:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408242432:0@lo:103: 00000100:00100000:0.0:1788651013.827242:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408241792:0@lo:103: 00000100:00100000:0.0:1788651013.827251:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408242304:0@lo:103: 00000100:00100000:0.0:1788651013.827272:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408241920:0@lo:103: 00000100:00100000:2.0:1788651013.833023:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240512:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651013.833040:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1875536408240640:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651013.833085:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651013.833850:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651013.835729:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345280 00000100:00100000:1.0:1788651013.835744:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345280 00010000:00010000:1.0:1788651013.835792:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.835840:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1788651013.835850:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389345280:12345-192.168.203.21@tcp:103: 00010000:00010000:1.0:1788651013.835864:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.835870:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.835882:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.835901:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670200/0x84a2fba8879771d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf13 expref: 10 pid: 5835 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.835917:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.835982:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:2355:x1875536389345280:12345-192.168.203.21@tcp:103: Request processed in 133us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.835989:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1788651013.836519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651013.837365:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345408 00000100:00100000:1.0:1788651013.837376:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345408 00010000:00010000:1.0:1788651013.837408:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651013.837442:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651013.837452:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:2356:x1875536389345408:12345-192.168.203.21@tcp:103: 00010000:00010000:1.0:1788651013.837478:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651013.837484:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837495:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837510:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cb200/0x84a2fba8879771dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf1a expref: 9 pid: 5833 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837524:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837532:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837548:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837554:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837561:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837568:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837573:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40030e00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651013.837577:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837742:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837762:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651013.837772:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651013.837831:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:2356:x1875536389345408:12345-192.168.203.21@tcp:103: Request processed in 380us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651013.837839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00010000:00010000:2.0:1788651013.837856:0:8431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651013.837876:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651013.837882:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030e00/0x84a2fba887977215 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651014.468728:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788651014.980306:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788651014.980317:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93bd412bd800 from 39 10000000:01000000:3.0:1788651014.980324:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788651014.980379:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651014.980390:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651014.980401:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651014.980424:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408242560:0@lo:101: 00000100:00100000:3.0:1788651014.980494:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651014.980566:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651014.980662:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242560 00000100:00100000:2.0:1788651014.980669:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242560 00000100:00100000:2.0:1788651014.980721:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788651014.980730:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+12:5838:x1875536408242560:12345-0@lo:101: 00010000:00010000:2.0:1788651014.980743:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651014.980757:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cd800/0x84a2fba887977223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797721c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651014.980778:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd800/0x84a2fba887977223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797721c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651014.980788:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cd800/0x84a2fba887977223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797721c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651014.980797:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cd800, rc 0) 00000100:00100000:2.0:1788651014.980844:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408242560:12345-0@lo:101: Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651014.980851:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788651014.980943:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408242560:0@lo:101: 00010000:00010000:3.0:1788651014.980958:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651014.980967:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651014.981023:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408242688:0@lo:501: 00000100:00100000:3.0:1788651014.981049:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651014.981078:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651014.984723:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242688 00000100:00100000:1.0:1788651014.984737:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242688 00000100:00100000:1.0:1788651014.984807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788651014.984817:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408242688:12345-0@lo:501: 00000100:00100000:1.0:1788651014.985139:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408242688:12345-0@lo:501: Request processed in 323us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651014.985147:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788651014.985374:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408242688:0@lo:501: 00000100:00100000:3.0:1788651014.985440:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408242816:0@lo:503: 00000100:00100000:3.0:1788651014.985486:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651014.985522:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651014.985570:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242816 00000100:00100000:0.0:1788651014.985575:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242816 00000100:00100000:0.0:1788651014.985619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788651014.985627:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408242816:12345-0@lo:503: 00000100:00100000:0.0:1788651014.985777:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408242816:12345-0@lo:503: Request processed in 151us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651014.985785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788651014.986040:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408242816:0@lo:503: 00000100:00100000:3.0:1788651014.986639:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8448:1875536408242944:0@lo:502: 00000100:00100000:3.0:1788651014.986686:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651014.986720:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651014.986772:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408242944 00000100:00100000:0.0:1788651014.986778:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408242944 00000100:00100000:0.0:1788651014.986819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788651014.986826:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:8448:x1875536408242944:12345-0@lo:502: 00000100:00100000:0.0:1788651014.987027:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+13:8448:x1875536408242944:12345-0@lo:502: Request processed in 200us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651014.987034:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788651014.987423:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8448:1875536408242944:0@lo:502: 00000100:00100000:3.0:1788651014.987468:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8448:1875536408243072:0@lo:502: 00000100:00100000:3.0:1788651014.987505:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651014.987535:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651014.987661:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243072 00000100:00100000:0.0:1788651014.987666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243072 00000100:00100000:0.0:1788651014.987699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788651014.987706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:8448:x1875536408243072:12345-0@lo:502: 00000100:00100000:0.0:1788651014.988260:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+13:8448:x1875536408243072:12345-0@lo:502: Request processed in 553us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651014.988268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788651014.991002:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8448:1875536408243072:0@lo:502: 00000040:00080000:3.0:1788651014.991052:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788651014.993284:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788651014.993328:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788651014.993340:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651014.993353:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651014.993364:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788651014.993367:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788651014.993369:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788651014.993411:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651014.993419:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651014.993450:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651014.993473:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243200:0@lo:101: 00000100:00100000:0.0:1788651014.993540:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651014.993651:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4611c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651014.998016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243200 00000100:00100000:2.0:1788651014.998034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243200 00000100:00100000:2.0:1788651014.998182:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788651014.998193:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+13:5838:x1875536408243200:12345-0@lo:101: 00010000:00010000:2.0:1788651014.998233:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651014.998254:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cd600/0x84a2fba887977231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797722a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651014.998284:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cd600/0x84a2fba887977231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797722a expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651014.998297:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cd600/0x84a2fba887977231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797722a expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651014.998307:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cd600, rc 0) 00000100:00100000:2.0:1788651014.999224:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408243200:12345-0@lo:101: Request processed in 1028us (5679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651014.999234:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788651014.999338:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243200:0@lo:101: 00010000:00010000:0.0:1788651014.999359:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651014.999370:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651014.999436:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243328:0@lo:501: 00000100:00100000:0.0:1788651014.999474:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.002589:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4611c0c0 going to sleep for 10 seconds 00000100:00100000:1.0:1788651015.005805:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243328 00000100:00100000:1.0:1788651015.005821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243328 00000100:00100000:1.0:1788651015.005880:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788651015.005890:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408243328:12345-0@lo:501: 00000100:00100000:1.0:1788651015.010121:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408243328:12345-0@lo:501: Request processed in 4210us (10623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.010135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788651015.010247:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243328:0@lo:501: 00000100:00100000:0.0:1788651015.010299:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243456:0@lo:503: 00000100:00100000:0.0:1788651015.010356:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.010390:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4611c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651015.010437:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243456 00000100:00100000:1.0:1788651015.010443:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243456 00000100:00100000:1.0:1788651015.010481:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788651015.010489:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408243456:12345-0@lo:503: 00000100:00100000:1.0:1788651015.010674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408243456:12345-0@lo:503: Request processed in 184us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.010681:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788651015.010764:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243456:0@lo:503: 00000100:00100000:0.0:1788651015.012189:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8449:1875536408243584:0@lo:502: 00000100:00100000:0.0:1788651015.012255:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.012296:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788651015.012348:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243584 00000100:00100000:1.0:1788651015.012355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243584 00000100:00100000:1.0:1788651015.012403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788651015.012412:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8449:x1875536408243584:12345-0@lo:502: 00000100:00100000:1.0:1788651015.012621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8449:x1875536408243584:12345-0@lo:502: Request processed in 208us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.012628:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788651015.012761:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8449:1875536408243584:0@lo:502: 00000020:01000000:0.0:1788651015.012793:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651015.012801:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651015.012803:0:8449:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788651015.012810:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788651015.012843:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8449:1875536408243712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651015.012876:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.012909:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651015.013062:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243712 00000100:00100000:3.0:1788651015.013067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243712 00000100:00100000:3.0:1788651015.013139:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788651015.013147:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8449:x1875536408243712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.013267:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:8449:x1875536408243712:12345-0@lo:502:llog_process_th.0 Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.013274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788651015.013446:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8449:1875536408243712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651015.013467:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651015.013472:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651015.013474:0:8449:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788651015.013478:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788651015.013651:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788651015.013669:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788651015.013679:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.013691:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651015.013707:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788651015.013710:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be7bfe0800 from 39 10000000:01000000:1.0:1788651015.013713:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788651015.013737:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.013745:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.013763:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651015.013778:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651015.013806:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651015.013831:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651015.013876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243840 00000100:00100000:0.0:1788651015.013881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243840 00000100:00100000:0.0:1788651015.013909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788651015.013916:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:5838:x1875536408243840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651015.013926:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651015.013938:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40031000/0x84a2fba88797723f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977238 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.013958:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40031000/0x84a2fba88797723f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977238 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.013968:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40031000/0x84a2fba88797723f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977238 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.013977:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40031000, rc 0) 00000100:00100000:0.0:1788651015.014016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408243840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.014031:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788651015.014148:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651015.014160:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.014169:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651015.014213:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651015.014236:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651015.014257:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651015.014332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408243968 00000100:00100000:0.0:1788651015.014337:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408243968 00000100:00100000:0.0:1788651015.014361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788651015.014367:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408243968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.014662:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408243968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.014669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788651015.014797:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408243968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651015.014844:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651015.014883:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651015.014945:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.019590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244096 00000100:00100000:2.0:1788651015.019613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244096 00000100:00100000:2.0:1788651015.019666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788651015.019676:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408244096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.019963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408244096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (5078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.019971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788651015.026402:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651015.027168:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8450:1875536408244224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.027247:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.027293:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651015.027412:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244224 00000100:00100000:0.0:1788651015.027420:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244224 00000100:00100000:0.0:1788651015.027470:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788651015.027479:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8450:x1875536408244224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651015.027748:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8450:x1875536408244224:12345-0@lo:502:llog_process_th.0 Request processed in 268us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.027761:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788651015.027966:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8450:1875536408244224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.028016:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8450:1875536408244352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.028053:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.028077:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651015.028146:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244352 00000100:00100000:1.0:1788651015.028151:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244352 00000100:00100000:1.0:1788651015.028187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788651015.028195:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8450:x1875536408244352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651015.028347:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+15:8450:x1875536408244352:12345-0@lo:502:llog_process_th.0 Request processed in 153us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.028361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788651015.028535:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8450:1875536408244352:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788651015.028556:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788651015.028827:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788651015.028844:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788651015.028854:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.028864:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651015.028873:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788651015.028876:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788651015.028879:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788651015.028905:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.028913:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.028922:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651015.028937:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651015.028972:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651015.029038:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.029912:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244480 00000100:00100000:2.0:1788651015.029922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244480 00000100:00100000:2.0:1788651015.029972:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788651015.029982:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:5838:x1875536408244480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651015.029995:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651015.030014:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be821cc400/0x84a2fba88797724d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977246 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.030057:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be821cc400/0x84a2fba88797724d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977246 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.030069:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be821cc400/0x84a2fba88797724d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977246 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.030079:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be821cc400, rc 0) 00000100:00100000:2.0:1788651015.030163:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408244480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.030170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788651015.030270:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651015.030287:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.030297:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651015.030361:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.030390:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.030430:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.030482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244608 00000100:00100000:2.0:1788651015.030486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244608 00000100:00100000:2.0:1788651015.030514:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788651015.030521:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408244608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.030773:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408244608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.030780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788651015.030958:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.030986:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.031026:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.031043:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.031339:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244736 00000100:00100000:2.0:1788651015.031344:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244736 00000100:00100000:2.0:1788651015.031376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788651015.031383:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408244736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.031535:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408244736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.031543:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788651015.031621:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408244736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.031952:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8451:1875536408244864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651015.031988:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.032018:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651015.032065:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244864 00000100:00100000:1.0:1788651015.032070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244864 00000100:00100000:1.0:1788651015.032102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788651015.032137:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8451:x1875536408244864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651015.032279:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8451:x1875536408244864:12345-0@lo:502:llog_process_th.0 Request processed in 143us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.032292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788651015.032377:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8451:1875536408244864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651015.032402:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651015.032410:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651015.032413:0:8451:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788651015.032421:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788651015.032439:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8451:1875536408244992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651015.032470:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.032493:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.032547:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408244992 00000100:00100000:2.0:1788651015.032552:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408244992 00000100:00100000:2.0:1788651015.032580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788651015.032586:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8451:x1875536408244992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651015.032744:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:8451:x1875536408244992:12345-0@lo:502:llog_process_th.0 Request processed in 158us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.032752:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788651015.032869:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8451:1875536408244992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651015.032887:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651015.032891:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651015.032893:0:8451:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788651015.032897:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788651015.033392:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788651015.033415:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788651015.033424:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.033435:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651015.033445:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788651015.033448:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be4384a800 from 39 10000000:01000000:2.0:1788651015.033450:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788651015.033477:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.033486:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.033495:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651015.033511:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408245120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.033545:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.033577:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651015.033646:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245120 00000100:00100000:1.0:1788651015.033651:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245120 00000100:00100000:1.0:1788651015.033685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788651015.033693:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408245120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651015.033702:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651015.033714:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9d600/0x84a2fba88797725b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977254 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.033735:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9d600/0x84a2fba88797725b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977254 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.033744:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9d600/0x84a2fba88797725b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977254 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.033751:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d600, rc 0) 00000100:00100000:1.0:1788651015.033792:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408245120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.033798:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788651015.033919:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408245120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651015.033941:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.033950:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651015.033992:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408245248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.034017:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.034037:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651015.034086:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245248 00000100:00100000:1.0:1788651015.034091:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245248 00000100:00100000:1.0:1788651015.034252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788651015.034260:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408245248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651015.034481:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408245248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.034489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788651015.034550:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408245248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.034577:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408245376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.034622:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.046646:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.047007:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408245504:0@lo:400:kworker.0 00000100:00100000:3.0:1788651015.047175:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245376 00000100:00100000:3.0:1788651015.047185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245376 00000100:00100000:2.0:1788651015.047412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.047662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408246016:0@lo:400:kworker.0 00000100:00100000:2.0:1788651015.047695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.047765:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246016 00000100:00100000:0.0:1788651015.047770:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246016 00000100:00100000:2.0:1788651015.047837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651015.047845:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408245632:0@lo:400:kworker.0 00000100:00100000:2.0:1788651015.047870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.047932:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651015.047942:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408246016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651015.048006:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408246016:12345-0@lo:400:kworker.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.048013:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651015.048673:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408245888:0@lo:400:kworker.0 00000100:00100000:0.0:1788651015.048713:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408245760:0@lo:400:kworker.0 00000100:00100000:0.0:1788651015.048738:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651015.048780:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245760 00000100:00100000:0.0:1788651015.048787:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245760 00000100:00100000:3.0:1788651015.049618:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245504 00010000:00080000:2.0:1788651015.049662:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe38a80 x1875536408246016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651015.049676:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408246016:0@lo:400:kworker.0 00000100:00100000:3.0:1788651015.049694:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245504 00000100:00100000:3.0:1788651015.049781:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245632 00000100:00100000:3.0:1788651015.049785:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245632 00000100:00080000:1.0:1788651015.050101:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651015.050125:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651015.050127:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651015.050348:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788651015.050356:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788651015.050361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408245504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651015.050371:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408245760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651015.050477:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408245760:12345-0@lo:400:kworker.0 Request processed in 111us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.050480:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408245504:12345-0@lo:400:kworker.0 Request processed in 122us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.050492:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788651015.050496:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651015.050516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651015.050526:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408245632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651015.050529:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.050567:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408245632:12345-0@lo:400:kworker.0 Request processed in 44us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.050575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788651015.050588:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe39500 x1875536408245760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651015.050590:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408245888 00000100:00100000:1.0:1788651015.050650:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408245632:0@lo:400:kworker.0 00000100:00100000:1.0:1788651015.050664:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408245504:0@lo:400:kworker.0 00000100:00100000:3.0:1788651015.050749:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408245888 00000100:00100000:3.0:1788651015.050788:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651015.050795:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408245888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651015.050840:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408245888:12345-0@lo:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.050846:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651015.050938:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408245760:0@lo:400:kworker.0 00000100:00100000:3.0:1788651015.051914:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408245888:0@lo:400:kworker.0 00000100:00080000:3.0:1788651015.052247:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651015.057744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651015.057759:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408245376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.057979:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408245376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (23355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.057987:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651015.058040:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408245376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651015.064584:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8452:1875536408246144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.064673:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.064714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246144 00000100:00100000:3.0:1788651015.064721:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246144 00000100:00100000:3.0:1788651015.064762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788651015.064772:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8452:x1875536408246144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.065006:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8452:x1875536408246144:12345-0@lo:502:llog_process_th.0 Request processed in 234us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.065014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788651015.065067:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651015.065089:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8452:1875536408246144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.065160:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8452:1875536408246272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.065194:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.065216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246272 00000100:00100000:3.0:1788651015.065220:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246272 00000100:00100000:3.0:1788651015.065242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788651015.065248:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8452:x1875536408246272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.065375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8452:x1875536408246272:12345-0@lo:502:llog_process_th.0 Request processed in 126us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.065625:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788651015.065662:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651015.065676:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8452:1875536408246272:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788651015.065696:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788651015.073289:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788651015.073329:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788651015.073342:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.073355:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651015.073366:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788651015.073369:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788651015.073372:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788651015.073428:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.073437:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.073448:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651015.073474:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408246400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.073540:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.073608:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651015.073681:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246400 00000100:00100000:0.0:1788651015.073690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246400 00000100:00100000:0.0:1788651015.073742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788651015.073752:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408246400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651015.073765:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651015.073780:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40031600/0x84a2fba887977269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977262 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.073806:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40031600/0x84a2fba887977269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977262 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.073832:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40031600/0x84a2fba887977269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977262 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651015.073841:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40031600, rc 0) 00000100:00100000:0.0:1788651015.073885:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408246400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.073891:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788651015.074054:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408246400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651015.074076:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.074085:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651015.074167:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408246528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.074194:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.074218:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651015.074274:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246528 00000100:00100000:0.0:1788651015.074279:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246528 00000100:00100000:0.0:1788651015.074311:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788651015.074317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408246528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.074579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408246528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.074587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788651015.074722:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408246528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.074752:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408246656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.074790:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.074820:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651015.074865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246656 00000100:00100000:0.0:1788651015.074870:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246656 00000100:00100000:0.0:1788651015.074902:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788651015.074909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408246656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651015.075053:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408246656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651015.075060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788651015.075529:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408246656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651015.076903:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8454:1875536408246784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.076971:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.077044:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.077080:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246784 00000100:00100000:2.0:1788651015.077086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246784 00000100:00100000:2.0:1788651015.077190:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788651015.077199:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8454:x1875536408246784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651015.077769:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8454:x1875536408246784:12345-0@lo:502:llog_process_th.0 Request processed in 570us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.077777:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788651015.079186:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8454:1875536408246784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651015.079229:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651015.079240:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651015.079242:0:8454:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788651015.079248:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788651015.079283:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8454:1875536408246912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651015.079359:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.079405:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4612ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651015.079671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408246912 00000100:00100000:2.0:1788651015.079678:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408246912 00000100:00100000:2.0:1788651015.079724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788651015.079733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8454:x1875536408246912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651015.079970:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8454:x1875536408246912:12345-0@lo:502:llog_process_th.0 Request processed in 236us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.079977:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788651015.080049:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8454:1875536408246912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651015.080068:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651015.080073:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651015.080074:0:8454:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788651015.080078:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788651015.080295:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788651015.080315:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788651015.080324:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.080349:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651015.080360:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788651015.080363:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93be45690000 from 1 10000000:01000000:2.0:1788651015.080366:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788651015.080411:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.080419:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.080428:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651015.080444:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408247040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.080475:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.080506:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651015.081931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247040 00000100:00100000:3.0:1788651015.081943:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247040 00000100:00100000:3.0:1788651015.081985:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788651015.081994:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408247040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651015.082006:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651015.082029:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429cae00/0x84a2fba887977277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977270 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651015.082055:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cae00/0x84a2fba887977277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977270 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651015.082066:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429cae00/0x84a2fba887977277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977270 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651015.082075:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cae00, rc 0) 00000100:00100000:3.0:1788651015.082142:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408247040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.082148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788651015.082502:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408247040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651015.082518:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.082534:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651015.082589:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408247168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651015.082628:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651015.082663:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651015.082708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247168 00000100:00100000:3.0:1788651015.082712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247168 00000100:00100000:3.0:1788651015.082740:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788651015.082747:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408247168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651015.082938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408247168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (309us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651015.082945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788651015.083009:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408247168:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788651015.083030:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788651015.083036:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651015.083044:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651015.495570:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651015.515485:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651015.515659:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345536 00000100:00100000:1.0:1788651015.515669:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345536 00000100:00100000:1.0:1788651015.515725:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 161 00000100:00100000:1.0:1788651015.515736:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+8:5593:x1875536389345536:12345-192.168.203.21@tcp:101: 00010000:00010000:1.0:1788651015.515752:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651015.515769:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9ce00/0x84a2fba88797727e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf7c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.515797:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9ce00/0x84a2fba88797727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf7c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.515807:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9ce00/0x84a2fba88797727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf7c expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.515816:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9ce00, rc 0) 00000100:00100000:1.0:1788651015.515875:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389345536:12345-192.168.203.21@tcp:101: Request processed in 140us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.515882:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 161 00000100:00100000:0.0:1788651015.519477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651015.519582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345664 00000100:00100000:2.0:1788651015.519600:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345664 00000100:00100000:2.0:1788651015.519648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:2.0:1788651015.519659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389345664:12345-192.168.203.21@tcp:501: 00000100:00100000:2.0:1788651015.519961:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389345664:12345-192.168.203.21@tcp:501: Request processed in 302us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.519970:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:0.0:1788651015.528640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651015.528719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345792 00000100:00100000:3.0:1788651015.528730:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345792 00000100:00100000:3.0:1788651015.528783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:3.0:1788651015.528794:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389345792:12345-192.168.203.21@tcp:503: 00000100:00100000:3.0:1788651015.529010:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389345792:12345-192.168.203.21@tcp:503: Request processed in 217us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.529018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:0.0:1788651015.534998:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651015.535202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389345920 00000100:00100000:1.0:1788651015.535281:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389345920 00000100:00100000:1.0:1788651015.535333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:1.0:1788651015.535346:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:6067:x1875536389345920:12345-192.168.203.21@tcp:502: 00000100:00100000:1.0:1788651015.536408:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:6067:x1875536389345920:12345-192.168.203.21@tcp:502: Request processed in 1060us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.536428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:0.0:1788651015.546322:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651015.546785:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346048 00000100:00100000:2.0:1788651015.546796:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346048 00000100:00100000:2.0:1788651015.546857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:2.0:1788651015.546868:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:6067:x1875536389346048:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651015.547188:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:6067:x1875536389346048:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 320us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651015.547199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:0.0:1788651015.554986:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651015.555704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346176 00000100:00100000:1.0:1788651015.555713:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346176 00000100:00100000:1.0:1788651015.555766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:1.0:1788651015.555782:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389346176:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651015.555795:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651015.555811:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9d200/0x84a2fba887977285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf83 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.555836:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9d200/0x84a2fba887977285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf83 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.555848:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9d200/0x84a2fba887977285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf83 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651015.555857:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d200, rc 0) 00000100:00100000:1.0:1788651015.556425:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389346176:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 641us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651015.556434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:2.0:1788651015.560508:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651015.560533:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408247296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651015.560611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651015.562715:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247296 00000100:00100000:3.0:1788651015.562731:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247296 00000100:00100000:3.0:1788651015.562801:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788651015.562813:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408247296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651015.562852:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651015.562939:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408247296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651015.562947:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788651015.563092:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6cf4f100 x1875536408247296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651015.563136:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408247296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651015.566002:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651015.566143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346304 00000100:00100000:3.0:1788651015.566152:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346304 00000100:00100000:3.0:1788651015.566210:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:3.0:1788651015.566221:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389346304:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651015.566498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389346304:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 278us (505us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651015.566506:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:0.0:1788651016.155546:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651016.155600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651016.155639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651016.155725:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346688 00000100:00100000:1.0:1788651016.155735:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346688 00000100:00100000:1.0:1788651016.155805:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346560 00000100:00100000:1.0:1788651016.155809:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346560 00000100:00100000:1.0:1788651016.155844:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651016.155854:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389346688:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651016.155938:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389346688:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 86us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651016.155945:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651016.155962:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1788651016.155968:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389346560:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651016.155993:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389346560:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651016.155999:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00080000:0.0:1788651016.156485:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651016.156489:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651016.156642:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346432 00000100:00100000:3.0:1788651016.156648:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346432 00000100:00100000:3.0:1788651016.156742:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1788651016.156750:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389346432:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651016.156810:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389346432:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 61us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.156816:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00080000:0.0:1788651016.161445:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651016.516270:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788651016.796444:0:8491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb181d2b0 20000000:00000080:0.0:1788651016.796462:0:8491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93be7bfd8c00 uarg=0000000000000000 20000000:01000000:0.0:1788651016.796500:0:8491:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788651016.796506:0:8491:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788651016.796510:0:8491:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788651016.797250:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788651016.797423:0:8491:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788651016.801568:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788651016.801639:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788651016.801702:0:8491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788651016.801720:0:8491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788651016.801741:0:8491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801760:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887976ffa expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801769:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797705c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801777:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977127 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801800:0:8491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801808:0:8491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801846:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.801862:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 9 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651016.801876:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247424:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651016.802033:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977127 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.802042:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977127 expref: 18 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651016.802051:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247552:0@lo:104: 00000100:00100000:1.0:1788651016.802087:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651016.802136:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797705c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.802144:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797705c expref: 18 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651016.802152:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247680:0@lo:104: 00000100:00100000:1.0:1788651016.802193:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651016.802213:0:8491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887976ffa expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.802221:0:8491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887976ffa expref: 18 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651016.802228:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247808:0@lo:104: 00000100:00100000:1.0:1788651016.802244:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651016.804363:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788651016.804559:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247424:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651016.804623:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651016.804639:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247552 00000100:00100000:3.0:1788651016.804646:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247552 00000100:00100000:3.0:1788651016.804681:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247680 00000100:00100000:3.0:1788651016.804693:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247680 00000100:00100000:3.0:1788651016.804708:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247808 00000100:00100000:3.0:1788651016.804710:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247808 00000100:00100000:3.0:1788651016.804722:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651016.804729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:8491:x1875536408247552:12345-0@lo:104: 00010000:00010000:3.0:1788651016.804744:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.804857:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651016.804864:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+5:8491:x1875536408247552:12345-0@lo:104: Request processed in 134us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.804872:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651016.804888:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788651016.804895:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7563d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+4:8491:x1875536408247680:12345-0@lo:104: 00010000:00010000:3.0:1788651016.804903:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.804937:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788651016.804942:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7563d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+4:8491:x1875536408247680:12345-0@lo:104: Request processed in 49us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.804947:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788651016.804974:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651016.804980:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:8491:x1875536408247808:12345-0@lo:104: 00010000:00010000:3.0:1788651016.804987:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805017:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788651016.805021:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+3:8491:x1875536408247808:12345-0@lo:104: Request processed in 42us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.805034:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788651016.805057:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788651016.805063:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805071:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671c00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651016.805076:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805084:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651016.805091:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651016.805096:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651016.805160:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805167:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651016.805187:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805194:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be41671c00/0x84a2fba887977127 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797712e expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805208:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651016.805211:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805228:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429caa00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651016.805231:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805238:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651016.805245:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651016.805250:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651016.805263:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805268:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651016.805275:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805281:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba88797705c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977063 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805290:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651016.805293:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805299:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cc000 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651016.805301:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805318:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651016.805324:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651016.805329:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651016.805342:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805347:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651016.805363:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805379:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821cc000/0x84a2fba887976ffa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977001 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805392:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651016.805394:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651016.805396:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651016.805402:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651016.805423:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408247936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651016.805460:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651016.805496:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651016.805502:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408248064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651016.805536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651016.805568:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408248192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651016.805604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651016.805645:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408247936 00000100:00100000:3.0:1788651016.805649:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408247936 00010000:00010000:3.0:1788651016.805670:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977127 expref: 19 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651016.805685:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248064 00000100:00100000:3.0:1788651016.805688:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248064 00010000:00010000:3.0:1788651016.805697:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797705c expref: 20 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651016.805708:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248192 00000100:00100000:3.0:1788651016.805710:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248192 00010000:00010000:3.0:1788651016.805719:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976ffa expref: 21 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651016.805731:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651016.805737:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+21:3308:x1875536408247936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651016.805747:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651016.805753:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977127 expref: 21 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805763:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977127 expref: 21 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805780:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651016.805808:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+21:3308:x1875536408247936:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.805815:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651016.805828:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651016.805833:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3308:x1875536408248064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651016.805849:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651016.805854:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797705c expref: 20 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805862:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797705c expref: 20 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805872:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651016.805893:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3308:x1875536408248064:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.805899:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651016.805911:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651016.805918:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408248192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651016.805925:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651016.805929:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887976ffa expref: 19 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805937:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887976ffa expref: 19 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.805947:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651016.805972:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408248192:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.805977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651016.806012:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408248192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651016.806035:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408248064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651016.806042:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408247936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651016.806241:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651016.806888:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cdc00/0x84a2fba88797712e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977127 expref: 18 pid: 5834 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651016.806905:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247552:0@lo:104: 00010000:00010000:2.0:1788651016.806917:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670600/0x84a2fba887977063 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797705c expref: 17 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651016.806927:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247680:0@lo:104: 00010000:00010000:2.0:1788651016.806937:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030200/0x84a2fba887977001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887976ffa expref: 16 pid: 5835 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651016.806947:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8491:1875536408247808:0@lo:104: 00010000:00010000:2.0:1788651016.806971:0:8491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651016.809070:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651016.809296:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346816 00000100:00100000:3.0:1788651016.809305:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346816 00010000:00010000:3.0:1788651016.809339:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 10 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651016.809458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:3.0:1788651016.809470:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2356:x1875536389346816:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651016.809484:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651016.809490:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 10 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809502:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 10 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809519:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9dc00/0x84a2fba8879771eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf4b expref: 10 pid: 5834 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809534:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809543:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809558:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809565:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809572:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809602:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809608:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651016.809612:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.809622:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.809751:0:8491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651016.809760:0:8491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.810984:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.810998:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9ca00/0x84a2fba88797728c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651016.811015:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651016.811092:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:2356:x1875536389346816:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1621us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651016.811101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:3.0:1788651017.096145:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408248320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651017.096220:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651017.096254:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248320 00000100:00100000:0.0:1788651017.096263:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248320 00000100:00100000:0.0:1788651017.096336:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788651017.096346:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408248320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651017.096381:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651017.096439:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408248320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651017.096446:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788651017.096528:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be74e00 x1875536408248320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651017.096548:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408248320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788651017.096726:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651017.401093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651017.401225:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389346944 00000100:00100000:1.0:1788651017.401235:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389346944 00000100:00100000:0.0:1788651017.401401:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:0.0:1788651017.401412:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:5593:x1875536389346944:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651017.401429:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651017.401446:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf8a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651017.401513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651017.401524:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651017.401533:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40030800, rc 0) 00000100:00100000:0.0:1788651017.401603:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389346944:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 193us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651017.401610:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:3.0:1788651017.404170:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651017.404310:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347072 00000100:00100000:2.0:1788651017.404320:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347072 00000100:00100000:2.0:1788651017.404375:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:2.0:1788651017.404384:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389347072:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651017.404675:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389347072:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 290us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.404682:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:3.0:1788651017.410475:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651017.410573:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347200 00000100:00100000:0.0:1788651017.410592:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347200 00000100:00100000:0.0:1788651017.410648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:0.0:1788651017.410660:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389347200:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651017.410876:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:5593:x1875536389347200:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 217us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651017.410884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:0.0:1788651017.415924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651017.416369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347328 00000100:00100000:3.0:1788651017.416384:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347328 00000100:00100000:3.0:1788651017.416458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:3.0:1788651017.416471:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:6125:x1875536389347328:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651017.416807:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:6125:x1875536389347328:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 337us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651017.416816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:1.0:1788651017.421932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651017.422052:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347456 00000100:00100000:3.0:1788651017.422067:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347456 00000100:00100000:3.0:1788651017.422169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:3.0:1788651017.422182:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:6125:x1875536389347456:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651017.422467:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:6125:x1875536389347456:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 287us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651017.422475:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 172 00010000:00010000:3.0:1788651017.540573:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788651017.931756:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651017.931762:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93bd412bd800 from 4 10000000:01000000:1.0:1788651017.931767:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651017.931821:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.931833:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.931844:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651017.931867:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408248448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.932331:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651017.932532:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248448 00000100:00100000:2.0:1788651017.932539:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248448 00000100:00100000:2.0:1788651017.932594:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788651017.932603:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408248448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651017.932616:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651017.932630:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797729a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.932653:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797729a expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.932662:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797729a expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.932671:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b800, rc 0) 00000100:00100000:2.0:1788651017.932703:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408248448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.932709:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788651017.932770:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.932791:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408248448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651017.932805:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.932815:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651017.932872:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408248576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.932977:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.933002:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.933018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248576 00000100:00100000:1.0:1788651017.933021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248576 00000100:00100000:1.0:1788651017.933048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788651017.933055:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408248576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.933327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408248576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.933333:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788651017.933383:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408248576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.933641:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408248704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.933678:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.933740:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651017.933882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248704 00000100:00100000:2.0:1788651017.933887:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248704 00000100:00100000:2.0:1788651017.934026:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788651017.934035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408248704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651017.934220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408248704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.934228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788651017.934312:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408248704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651017.934497:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8550:1875536408248832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651017.934530:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651017.934790:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.934834:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248832 00000100:00100000:1.0:1788651017.934839:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248832 00000100:00100000:1.0:1788651017.934862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788651017.934876:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8550:x1875536408248832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.935035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8550:x1875536408248832:12345-0@lo:502:llog_process_th.0 Request processed in 159us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.935042:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788651017.935210:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8550:1875536408248832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651017.935232:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651017.935245:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651017.935248:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788651017.935256:0:8550:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93bd412bd800 00000020:00000080:0.0:1788651017.935259:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788651017.935333:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8550:1875536408248960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651017.935382:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651017.935411:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651017.937316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408248960 00000100:00100000:2.0:1788651017.937326:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408248960 00000100:00100000:2.0:1788651017.938638:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788651017.938652:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8550:x1875536408248960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651017.939000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:8550:x1875536408248960:12345-0@lo:502:llog_process_th.0 Request processed in 351us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.939009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788651017.939143:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8550:1875536408248960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651017.939176:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651017.939184:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651017.939186:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788651017.939192:0:8550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788651017.940028:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788651017.940046:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651017.940056:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.940068:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651017.940078:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788651017.940081:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7bfe0800 from 4 10000000:01000000:2.0:1788651017.940083:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788651017.940136:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.940144:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.940166:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651017.940187:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788651017.940235:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651017.940281:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be456e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788651017.940299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249088 00000100:00100000:2.0:1788651017.940305:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249088 00000100:00100000:2.0:1788651017.940343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788651017.940353:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408249088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651017.941377:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651017.941395:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879772a8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.941431:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.941441:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.941513:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a400, rc 0) 00000100:00100000:2.0:1788651017.941589:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408249088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1237us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.941597:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788651017.941780:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651017.941802:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.941811:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651017.941887:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.941927:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.943032:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73480 going to sleep for 11 seconds 00000100:00100000:2.0:1788651017.943138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249216 00000100:00100000:2.0:1788651017.943146:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249216 00000100:00100000:2.0:1788651017.943199:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788651017.943209:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408249216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651017.943760:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408249216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 550us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.943769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788651017.944326:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.944382:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.944601:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.944633:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73480 going to sleep for 11 seconds 00000100:00100000:2.0:1788651017.944690:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249344 00000100:00100000:2.0:1788651017.944696:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249344 00000100:00100000:2.0:1788651017.944732:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788651017.944740:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408249344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.944988:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.945310:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8552:1875536408249472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.945556:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.945592:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651017.945726:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408249344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 985us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.945735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788651017.945766:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249472 00000100:00100000:2.0:1788651017.945771:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249472 00000100:00100000:2.0:1788651017.945831:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788651017.945839:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8552:x1875536408249472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651017.946028:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8552:x1875536408249472:12345-0@lo:502:llog_process_th.0 Request processed in 189us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651017.946035:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788651017.946209:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8552:1875536408249472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651017.946237:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651017.946251:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651017.946254:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788651017.946261:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be7bfe0800 00000020:00000080:1.0:1788651017.946264:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651017.947067:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8552:1875536408249600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.947181:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.947205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249600 00000100:00100000:1.0:1788651017.947209:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249600 00000100:00100000:1.0:1788651017.947231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788651017.947237:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8552:x1875536408249600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.947679:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:8552:x1875536408249600:12345-0@lo:502:llog_process_th.0 Request processed in 440us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.947687:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788651017.947730:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.947746:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8552:1875536408249600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651017.947768:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651017.947774:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651017.947776:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788651017.947780:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788651017.948904:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788651017.948926:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651017.948936:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.948947:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651017.948958:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788651017.948961:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be4384a800 from 4 10000000:01000000:2.0:1788651017.948970:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788651017.949001:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.949009:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651017.949018:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651017.949036:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788651017.949080:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651017.949158:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd41086d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.950585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249728 00000100:00100000:1.0:1788651017.950596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249728 00000100:00100000:1.0:1788651017.950640:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788651017.950648:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408249728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651017.950663:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651017.950677:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879772b6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.950700:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.950718:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.950726:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:1.0:1788651017.950797:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408249728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.950803:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788651017.950855:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651017.950872:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651017.950882:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651017.950948:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.950976:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.951002:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.951013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249856 00000100:00100000:1.0:1788651017.951017:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249856 00000100:00100000:1.0:1788651017.951038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788651017.951044:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408249856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.951286:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408249856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.951294:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788651017.951321:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.951358:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.951425:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.951969:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.951987:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408249984 00000100:00100000:1.0:1788651017.951992:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408249984 00000100:00100000:1.0:1788651017.952017:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788651017.952024:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408249984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.952995:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408249984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 967us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.953003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788651017.953628:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408249984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651017.959984:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8555:1875536408250112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.960057:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.960553:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250112 00000100:00100000:1.0:1788651017.960562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250112 00000100:00100000:1.0:1788651017.960615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788651017.960623:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:8555:x1875536408250112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.961641:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:8555:x1875536408250112:12345-0@lo:502:llog_process_th.0 Request processed in 1017us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.961650:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788651017.962000:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.962021:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8555:1875536408250112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651017.962051:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651017.962059:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651017.962061:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788651017.962067:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be4384a800 00000020:00000080:1.0:1788651017.962075:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651017.962396:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8555:1875536408250240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.962434:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651017.963546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250240 00000100:00100000:1.0:1788651017.963556:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250240 00000100:00100000:1.0:1788651017.963611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788651017.963621:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:8555:x1875536408250240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651017.964175:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:8555:x1875536408250240:12345-0@lo:502:llog_process_th.0 Request processed in 553us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651017.964184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788651017.964230:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651017.964253:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:8555:1875536408250240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651017.964278:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651017.964285:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651017.964287:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788651017.964291:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788651017.971559:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788651017.971604:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651017.971616:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651017.971628:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651018.565016:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651019.589676:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651020.170956:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408250368:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.171059:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.171299:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651020.171312:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408250496:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.171348:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.171392:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408250624:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.171432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.171483:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250496 00000100:00100000:0.0:1788651020.171493:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250496 00000100:00100000:0.0:1788651020.171549:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250624 00000100:00100000:0.0:1788651020.171553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250624 00000100:00100000:3.0:1788651020.171645:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651020.171660:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651020.171738:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408250496:12345-0@lo:400:kworker.0 Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651020.171747:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651020.171772:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651020.171780:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408250624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651020.171821:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408250624:12345-0@lo:400:kworker.0 Request processed in 43us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651020.171828:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788651020.171900:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408250624:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.171987:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408251008:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.172021:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.172045:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651020.172051:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408250880:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.172073:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.172095:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250880 00000100:00100000:0.0:1788651020.172099:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250880 00000100:00100000:0.0:1788651020.172330:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788651020.172339:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408250880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.172376:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408250880:12345-0@lo:400:kworker.0 Request processed in 39us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651020.172383:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788651020.172412:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408250880:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.172427:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651020.172434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408250752:0@lo:400:kworker.0 00000100:00100000:0.0:1788651020.172458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.172525:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408250496:0@lo:400:kworker.0 00000100:00100000:1.0:1788651020.174394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250368 00000100:00100000:1.0:1788651020.174411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250368 00000100:00100000:1.0:1788651020.174467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788651020.174479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408250368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651020.174697:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408250368:12345-0@lo:400:kworker.0 Request processed in 220us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651020.174705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1788651020.174745:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651020.174762:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251008 00000100:00100000:1.0:1788651020.174766:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251008 00000100:00100000:1.0:1788651020.174798:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408250752 00000100:00100000:1.0:1788651020.174809:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408250752 00000100:00100000:1.0:1788651020.174826:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651020.174832:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408251008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651020.174872:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408251008:12345-0@lo:400:kworker.0 Request processed in 40us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651020.174879:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651020.174892:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651020.174898:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408250752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651020.174930:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408250752:12345-0@lo:400:kworker.0 Request processed in 33us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651020.174936:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788651020.175012:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651020.175015:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651020.177165:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408250368:0@lo:400:kworker.0 00010000:00080000:0.0:1788651020.177869:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be74700 x1875536408251008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651020.177888:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408251008:0@lo:400:kworker.0 00010000:00080000:0.0:1788651020.177937:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be77100 x1875536408250752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651020.177948:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408250752:0@lo:400:kworker.0 00010000:00010000:3.0:1788651020.618660:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651020.689839:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651020.690645:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408251136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651020.690743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651020.691032:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251136 00000100:00100000:0.0:1788651020.691042:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251136 00000100:00100000:0.0:1788651020.691102:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651020.691129:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408251136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651020.691176:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651020.691236:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408251136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651020.691243:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788651020.691294:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3b100 x1875536408251136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651020.691315:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408251136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651021.277169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651021.277211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651021.277232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651021.277253:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651021.277286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347584 00000100:00100000:0.0:1788651021.277298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347584 00000100:00100000:0.0:1788651021.277359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 189 00000100:00100000:0.0:1788651021.277370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389347584:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651021.277447:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389347584:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651021.277454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 189 00000100:00100000:0.0:1788651021.277502:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347840 00000100:00100000:0.0:1788651021.277505:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347840 00000100:00100000:0.0:1788651021.277546:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347968 00000100:00100000:0.0:1788651021.277559:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347968 00000100:00100000:0.0:1788651021.277580:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1788651021.277595:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389347840:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651021.277623:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389347840:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 38us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651021.277629:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1788651021.277639:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1788651021.277644:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389347968:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651021.277661:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389347968:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 17us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651021.277667:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1788651021.277682:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389347712 00000100:00100000:0.0:1788651021.277685:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389347712 00000100:00100000:0.0:1788651021.277712:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:0.0:1788651021.277718:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389347712:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651021.277744:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389347712:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651021.277750:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00080000:0.0:1788651021.277877:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651021.277882:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651021.277884:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788651021.636770:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651022.212514:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651022.212536:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408251264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651022.212638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651022.212700:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251264 00000100:00100000:0.0:1788651022.212707:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251264 00000100:00100000:0.0:1788651022.212761:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788651022.212771:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408251264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651022.212808:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651022.212853:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408251264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651022.212859:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788651022.212880:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788651022.212908:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be76a00 x1875536408251264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651022.212926:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408251264:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788651022.627583:0:8792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788651022.661217:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651023.691684:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651024.710890:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651025.287975:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408251520:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288041:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651025.288092:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408252032:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288130:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651025.288159:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788651025.288165:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408251392:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288189:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651025.288205:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408251904:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288231:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651025.288253:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408251648:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651025.288292:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651025.288312:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408251776:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288335:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651025.288365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251520 00000100:00100000:2.0:1788651025.288372:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251520 00000100:00100000:2.0:1788651025.288410:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251904 00000100:00100000:2.0:1788651025.288413:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251904 00000100:00100000:2.0:1788651025.288434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251648 00000100:00100000:2.0:1788651025.288438:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251648 00000100:00100000:2.0:1788651025.288454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651025.288462:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408251520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288512:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408251520:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651025.288519:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651025.288545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651025.288551:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408251904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288578:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408251904:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651025.288585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651025.288595:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788651025.288600:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408251648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288623:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408251648:12345-0@lo:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651025.288628:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788651025.288651:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252032 00000100:00100000:2.0:1788651025.288655:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252032 00000100:00100000:2.0:1788651025.288676:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251776 00000100:00100000:2.0:1788651025.288678:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251776 00000100:00100000:2.0:1788651025.288689:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651025.288695:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408252032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288720:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408252032:12345-0@lo:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651025.288725:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651025.288734:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651025.288738:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408251776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288759:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408251776:12345-0@lo:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651025.288764:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788651025.288788:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651025.288792:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651025.288795:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788651025.288823:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556a680 x1875536408251776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651025.288837:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408251776:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288848:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408251648:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288876:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408251904:0@lo:400:kworker.0 00000100:00100000:2.0:1788651025.288885:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408251520:0@lo:400:kworker.0 00010000:00080000:2.0:1788651025.288893:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556aa00 x1875536408252032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651025.288913:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408252032:0@lo:400:kworker.0 00000100:00100000:1.0:1788651025.289100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408251392 00000100:00100000:1.0:1788651025.289125:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408251392 00000100:00100000:1.0:1788651025.289155:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788651025.289163:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408251392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651025.289203:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408251392:12345-0@lo:400:kworker.0 Request processed in 41us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651025.289209:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788651025.289341:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408251392:0@lo:400:kworker.0 00010000:00010000:1.0:1788651025.732719:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651025.796262:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408252160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651025.796330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651025.796423:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252160 00000100:00100000:0.0:1788651025.796430:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252160 00000100:00100000:0.0:1788651025.796477:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788651025.796487:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408252160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651025.796528:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651025.796572:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408252160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651025.796579:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788651025.796618:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be76a00 x1875536408252160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651025.796635:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408252160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651026.395418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651026.395470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651026.395500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651026.395536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651026.395564:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348480 00000100:00100000:1.0:1788651026.395581:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348480 00000100:00100000:1.0:1788651026.395631:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348352 00000100:00100000:1.0:1788651026.395634:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348352 00000100:00100000:1.0:1788651026.395657:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1788651026.395666:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389348480:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651026.395736:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389348480:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651026.395744:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1788651026.395762:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651026.395768:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389348352:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651026.395804:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389348352:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 36us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651026.395811:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651026.395828:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348096 00000100:00100000:1.0:1788651026.395831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348096 00000100:00100000:1.0:1788651026.395854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 191 00000100:00100000:1.0:1788651026.395860:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2354:x1875536389348096:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651026.395883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2354:x1875536389348096:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651026.395889:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 191 00000100:00080000:1.0:1788651026.395916:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651026.395919:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651026.396267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348224 00000100:00100000:3.0:1788651026.396272:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348224 00000100:00100000:3.0:1788651026.396318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:3.0:1788651026.396326:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389348224:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651026.396365:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389348224:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 40us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651026.396371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00080000:1.0:1788651026.396502:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651026.756410:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651027.334536:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408252288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651027.334614:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651027.336824:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252288 00000100:00100000:2.0:1788651027.336980:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252288 00000100:00080000:3.0:1788651027.337046:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651027.337052:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788651027.337062:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408252288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651027.337100:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651027.337298:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408252288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651027.337306:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788651027.340286:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be765e6300 x1875536408252288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651027.340325:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408252288:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788651027.690524:0:9036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing yml_node 00010000:00010000:2.0:1788651027.781416:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651028.805291:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651029.828762:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651030.405667:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408252672:0@lo:400:kworker.0 00000100:00100000:0.0:1788651030.405778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651030.405848:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651030.405854:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408252800:0@lo:400:kworker.0 00000100:00100000:0.0:1788651030.405887:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651030.406074:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408252416:0@lo:400:kworker.0 00000100:00100000:3.0:1788651030.406153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651030.407047:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408252544:0@lo:400:kworker.0 00000100:00100000:1.0:1788651030.407099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651030.407561:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252672 00000100:00100000:2.0:1788651030.407569:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252672 00000100:00100000:2.0:1788651030.407624:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252544 00000100:00100000:2.0:1788651030.407627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252544 00000100:00100000:2.0:1788651030.407649:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651030.407659:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408252672:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788651030.407725:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651030.407740:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788651030.407749:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408252544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651030.407800:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408252544:12345-0@lo:400:kworker.0 Request processed in 53us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651030.407810:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651030.407811:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408252672:12345-0@lo:400:kworker.0 Request processed in 151us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651030.407823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788651030.407856:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408252672:0@lo:400:kworker.0 00000100:00100000:2.0:1788651030.407869:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252416 00000100:00100000:2.0:1788651030.407875:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252416 00000100:00100000:2.0:1788651030.407917:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788651030.407924:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408252416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651030.407967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408252416:12345-0@lo:400:kworker.0 Request processed in 44us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651030.407974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788651030.408853:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252800 00000100:00100000:0.0:1788651030.408861:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252800 00000100:00100000:0.0:1788651030.408908:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788651030.408915:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408252800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651030.409232:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408252800:12345-0@lo:400:kworker.0 Request processed in 316us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651030.409240:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788651030.409260:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788651030.409299:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751c9180 x1875536408252800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651030.409313:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408252800:0@lo:400:kworker.0 00000100:00100000:3.0:1788651030.409775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408252416:0@lo:400:kworker.0 00000100:00100000:3.0:1788651030.409787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408252928:0@lo:400:kworker.0 00000100:00100000:3.0:1788651030.409820:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651030.411775:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408252928 00000100:00100000:0.0:1788651030.411788:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408252928 00000100:00100000:0.0:1788651030.411910:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788651030.411920:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408252928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651030.412001:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408252928:12345-0@lo:400:kworker.0 Request processed in 83us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651030.412008:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788651030.412354:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408252928:0@lo:400:kworker.0 00000100:00080000:2.0:1788651030.412708:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651030.413565:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408252544:0@lo:400:kworker.0 00000100:00100000:1.0:1788651030.413580:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408253056:0@lo:400:kworker.0 00000100:00100000:1.0:1788651030.413629:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651030.414092:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253056 00000100:00100000:2.0:1788651030.414100:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253056 00000100:00100000:2.0:1788651030.414328:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788651030.414346:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408253056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651030.414418:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408253056:12345-0@lo:400:kworker.0 Request processed in 82us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651030.414425:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788651030.414547:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751c8700 x1875536408253056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651030.414561:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408253056:0@lo:400:kworker.0 00000100:00080000:0.0:1788651030.417623:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788651030.852964:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651030.916530:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651030.926027:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408253184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651030.926134:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651030.926307:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253184 00000100:00100000:2.0:1788651030.926315:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253184 00000100:00100000:2.0:1788651030.926370:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651030.926380:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408253184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651030.926416:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651030.926461:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408253184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651030.926468:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788651030.926577:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751c9180 x1875536408253184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651030.926596:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408253184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651031.529793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651031.529847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651031.529883:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348736 00000100:00100000:1.0:1788651031.529892:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348736 00000100:00100000:1.0:1788651031.529975:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:1.0:1788651031.529990:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389348736:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651031.530067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389348736:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651031.530075:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00080000:1.0:1788651031.530094:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651031.530251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348608 00000100:00100000:2.0:1788651031.530256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348608 00000100:00100000:2.0:1788651031.530281:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:2.0:1788651031.530288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389348608:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651031.530313:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389348608:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651031.530333:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:0.0:1788651031.543065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651031.543251:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651031.558781:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348864 00000100:00100000:1.0:1788651031.558797:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348864 00000100:00100000:0.0:1788651031.559994:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389348992 00000100:00100000:0.0:1788651031.560002:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389348992 00000100:00100000:0.0:1788651031.560037:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1788651031.560048:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2352:x1875536389348864:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:0.0:1788651031.560087:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879771f9 00000100:00080000:0.0:1788651031.560097:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93be75633000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788651031.560162:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1788651031.560383:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651031.560387:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651031.560400:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651031.561528:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+2:2352:x1875536389348864:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 1477us (18469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651031.561542:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1788651031.561563:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1788651031.561571:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2352:x1875536389348992:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:0.0:1788651031.561591:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887977200 00000100:00080000:0.0:1788651031.561599:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93be75634800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788651031.561623:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788651031.561863:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651031.562405:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+2:2352:x1875536389348992:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 832us (19151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651031.562427:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000001:02000400:2.0:1788651031.855369:0:9227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00010000:00010000:3.0:1788651031.882699:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651032.453504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651032.453535:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408253312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651032.453630:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651032.453713:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253312 00000100:00100000:2.0:1788651032.453724:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253312 00000100:00100000:2.0:1788651032.453966:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651032.453978:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408253312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651032.454025:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651032.454089:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408253312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651032.454098:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788651032.454227:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556aa00 x1875536408253312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651032.454251:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408253312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788651032.454396:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651032.900391:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651033.926540:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788651034.343047:0:9325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00000001:00100000:3.0:1788651034.582271:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:3.0:1788651034.582281:0:6698:0:(genops.c:885:class_export_put()) final put ffff93be75631000/f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:2.0:1788651034.585143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93be75631000/f051ebe0-0677-425e-9b9b-54befcd9fd1c for lustre-OST0000 00000020:00000080:2.0:1788651034.585213:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be75633000 for lustre-OST0000 00010000:00010000:2.0:1788651034.949897:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651035.525771:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408253824:0@lo:400:kworker.0 00000100:00100000:1.0:1788651035.525837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651035.525900:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651035.525907:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408253696:0@lo:400:kworker.0 00000100:00100000:1.0:1788651035.525950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651035.525981:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253824 00000100:00100000:1.0:1788651035.525988:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253824 00000100:00100000:1.0:1788651035.526052:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788651035.526063:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408253824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651035.526134:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408253824:12345-0@lo:400:kworker.0 Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651035.526142:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788651035.526165:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253696 00000100:00100000:1.0:1788651035.526168:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253696 00000100:00100000:1.0:1788651035.526190:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788651035.526197:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408253696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651035.526226:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408253696:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651035.526231:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788651035.526257:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651035.526261:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651035.526288:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408253696:0@lo:400:kworker.0 00010000:00080000:1.0:1788651035.526301:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3d180 x1875536408253824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651035.526310:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408253824:0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526618:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408253568:0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526645:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651035.526671:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408254080:0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526692:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651035.526717:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788651035.526722:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408253440:0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526746:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651035.526767:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408253952:0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526787:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651035.526815:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253568 00000100:00100000:3.0:1788651035.526819:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253568 00000100:00100000:3.0:1788651035.526843:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253952 00000100:00100000:3.0:1788651035.526846:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253952 00000100:00100000:3.0:1788651035.526864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788651035.526869:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408253568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526903:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408253568:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651035.526909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788651035.526920:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651035.526935:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408253952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.526960:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408253952:12345-0@lo:400:kworker.0 Request processed in 27us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651035.526966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651035.526980:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254080 00000100:00100000:3.0:1788651035.526983:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254080 00000100:00100000:3.0:1788651035.527004:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651035.527010:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408254080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.527034:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408254080:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651035.527053:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651035.527068:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408253440 00000100:00100000:3.0:1788651035.527071:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408253440 00000100:00100000:3.0:1788651035.527092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788651035.527097:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408253440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651035.527145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408253440:12345-0@lo:400:kworker.0 Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651035.527151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:3.0:1788651035.527176:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651035.527180:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651035.527478:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408253440:0@lo:400:kworker.0 00000100:00100000:2.0:1788651035.527490:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408253952:0@lo:400:kworker.0 00000100:00100000:2.0:1788651035.527498:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408253568:0@lo:400:kworker.0 00010000:00080000:2.0:1788651035.527508:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3fb80 x1875536408254080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651035.527517:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408254080:0@lo:400:kworker.0 00000001:00100000:3.0:1788651035.574008:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:3.0:1788651035.574018:0:7633:0:(genops.c:885:class_export_put()) final put ffff93be75635000/f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:2.0:1788651035.574846:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93be75635000/f051ebe0-0677-425e-9b9b-54befcd9fd1c for lustre-OST0001 00000020:00000080:2.0:1788651035.576556:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be75634800 for lustre-OST0001 00010000:00010000:1.0:1788651035.974495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651036.037779:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408254208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651036.037848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651036.039683:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254208 00000100:00100000:2.0:1788651036.039695:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254208 00000100:00100000:2.0:1788651036.039746:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651036.039765:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408254208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651036.039804:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788651036.047062:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751cb800 x1875536408254208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651036.047062:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408254208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7298us (9204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651036.047081:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651036.047096:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408254208:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788651036.634320:0:9425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:0.0:1788651036.648246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651036.648544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651036.650526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349248 00000100:00100000:3.0:1788651036.650539:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349248 00000100:00100000:3.0:1788651036.650613:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1788651036.650623:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389349248:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651036.650703:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389349248:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 82us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651036.650711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00080000:0.0:1788651036.651055:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651036.651862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349120 00000100:00100000:1.0:1788651036.651869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349120 00000100:00100000:1.0:1788651036.651947:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:1.0:1788651036.651957:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389349120:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651036.652029:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389349120:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 73us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651036.652037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 195 00010000:00010000:1.0:1788651036.996346:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651037.572487:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408254336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651037.572559:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651037.572678:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254336 00000100:00100000:1.0:1788651037.572686:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254336 00000100:00100000:1.0:1788651037.572758:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788651037.572768:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408254336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651037.572804:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788651037.572893:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651037.573586:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408254336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 816us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651037.573596:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788651037.573680:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556a680 x1875536408254336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651037.573700:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408254336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788651038.033104:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788651038.186092:0:9473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 19:30:37 EDT 2026 00010000:00010000:1.0:1788651039.044407:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651040.073224:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651040.649971:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408254464:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.651503:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651040.651605:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408254976:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.651640:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651040.651673:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788651040.651680:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408254592:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.651704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651040.651723:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408255104:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.651746:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651040.651778:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408254720:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.651801:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651040.651822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651040.651827:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408254848:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.651862:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651040.652051:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254976 00000100:00100000:0.0:1788651040.652060:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254976 00000100:00100000:0.0:1788651040.652132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254592 00000100:00100000:0.0:1788651040.652136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254592 00000100:00100000:0.0:1788651040.652150:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254720 00000100:00100000:0.0:1788651040.652153:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254720 00000100:00100000:0.0:1788651040.652171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788651040.652178:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408254976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652230:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408254976:12345-0@lo:400:kworker.0 Request processed in 52us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651040.652238:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788651040.652255:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788651040.652261:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408254592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652288:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408254592:12345-0@lo:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651040.652294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788651040.652305:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651040.652311:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408254720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652341:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408254720:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651040.652346:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651040.652367:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255104 00000100:00100000:0.0:1788651040.652371:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255104 00000100:00100000:0.0:1788651040.652394:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254848 00000100:00100000:0.0:1788651040.652397:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254848 00000100:00100000:0.0:1788651040.652412:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651040.652431:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408255104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652472:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408255104:12345-0@lo:400:kworker.0 Request processed in 54us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651040.652479:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651040.652491:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651040.652497:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408254848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652523:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408254848:12345-0@lo:400:kworker.0 Request processed in 26us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651040.652529:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788651040.652582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651040.652587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651040.652589:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651040.652623:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408254592:0@lo:400:kworker.0 00010000:00080000:0.0:1788651040.652639:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751cb100 x1875536408255104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651040.652650:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408255104:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652661:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408254976:0@lo:400:kworker.0 00010000:00080000:0.0:1788651040.652695:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751cbb80 x1875536408254848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651040.652705:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408254848:0@lo:400:kworker.0 00000100:00100000:0.0:1788651040.652716:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408254720:0@lo:400:kworker.0 00000100:00100000:1.0:1788651040.656526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408254464 00000100:00100000:1.0:1788651040.656540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408254464 00000100:00100000:1.0:1788651040.656590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788651040.656600:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408254464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651040.656681:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408254464:12345-0@lo:400:kworker.0 Request processed in 83us (5184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651040.656689:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788651040.656853:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408254464:0@lo:400:kworker.0 00010000:00010000:1.0:1788651041.092776:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651041.158508:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651041.158533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408255232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651041.158603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651041.158750:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255232 00000100:00100000:3.0:1788651041.158758:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255232 00000100:00100000:1.0:1788651041.158837:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651041.158856:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408255232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651041.159157:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651041.159272:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408255232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 418us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651041.159281:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788651041.159395:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be765e4e00 x1875536408255232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651041.159440:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408255232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651041.759799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651041.759961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651041.760039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349504 00000100:00100000:0.0:1788651041.760048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349504 00000100:00100000:0.0:1788651041.760143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:0.0:1788651041.760154:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389349504:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651041.760499:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389349504:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 346us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651041.760796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00080000:3.0:1788651041.761022:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651041.761471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349376 00000100:00100000:1.0:1788651041.761480:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349376 00000100:00100000:1.0:1788651041.761575:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:1.0:1788651041.761585:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389349376:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651041.761647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2355:x1875536389349376:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 63us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651041.761654:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 197 00010000:00010000:1.0:1788651042.118147:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651042.695584:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408255360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651042.695658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651042.695873:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255360 00000100:00100000:3.0:1788651042.695881:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255360 00000100:00100000:3.0:1788651042.695941:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651042.695953:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408255360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651042.698098:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788651042.705389:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651042.708908:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408255360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12950us (13240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651042.708923:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788651042.718321:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556b800 x1875536408255360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651042.718348:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408255360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788651043.141328:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651044.166171:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651045.188258:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651045.764744:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408255744:0@lo:400:kworker.0 00000100:00100000:0.0:1788651045.764810:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408255488:0@lo:400:kworker.0 00000100:00100000:3.0:1788651045.764832:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651045.764942:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788651045.769856:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651045.769928:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408256000:0@lo:400:kworker.0 00000100:00100000:2.0:1788651045.772439:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255744 00000100:00100000:2.0:1788651045.772454:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255744 00000100:00100000:2.0:1788651045.772516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788651045.772528:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408255744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651045.774363:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408255616:0@lo:400:kworker.0 00000100:00100000:1.0:1788651045.774466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651045.774535:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255872 00000100:00100000:1.0:1788651045.774542:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255872 00000100:00100000:1.0:1788651045.774592:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788651045.774601:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408255872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651045.774666:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408255872:12345-0@lo:400:kworker.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651045.774685:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788651045.775680:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255488 00000100:00100000:0.0:1788651045.775689:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255488 00000100:00100000:0.0:1788651045.775725:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788651045.775734:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408255488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651045.775785:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408255488:12345-0@lo:400:kworker.0 Request processed in 54us (5937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651045.775792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788651045.775822:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651045.775827:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651045.776284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408255744:12345-0@lo:400:kworker.0 Request processed in 3756us (11450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651045.776293:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788651045.776356:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408255744:0@lo:400:kworker.0 00010000:00080000:2.0:1788651045.776418:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be765e6680 x1875536408255872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651045.776429:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408255872:0@lo:400:kworker.0 00000100:00100000:0.0:1788651045.778336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651045.778544:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256000 00000100:00100000:2.0:1788651045.778555:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256000 00000100:00100000:0.0:1788651045.778595:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408255488:0@lo:400:kworker.0 00000100:00080000:0.0:1788651045.778607:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651045.778619:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788651045.778630:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408256000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651045.778700:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408256000:12345-0@lo:400:kworker.0 Request processed in 73us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651045.778707:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651045.779039:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408256000:0@lo:400:kworker.0 00000100:00100000:3.0:1788651045.787467:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651045.787521:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788651045.787572:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651045.787687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408255616 00000100:00100000:0.0:1788651045.787696:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408255616 00000100:00100000:0.0:1788651045.787761:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788651045.787772:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408255616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651045.787842:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408255616:12345-0@lo:400:kworker.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651045.787849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788651045.788511:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408255616:0@lo:400:kworker.0 00000100:00100000:1.0:1788651045.789036:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256128 00000100:00100000:1.0:1788651045.789045:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256128 00000100:00100000:1.0:1788651045.789133:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788651045.789143:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408256128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651045.789215:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408256128:12345-0@lo:400:kworker.0 Request processed in 75us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651045.789223:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788651045.789571:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788651045.790401:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be765e6a00 x1875536408256128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651045.790416:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408256128:0@lo:400:kworker.0 00010000:00010000:3.0:1788651046.221303:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651046.276499:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408256256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651046.276573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651046.276684:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256256 00000100:00100000:3.0:1788651046.277269:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256256 00000100:00100000:3.0:1788651046.277327:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651046.277337:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408256256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651046.277378:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651046.277451:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408256256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651046.277458:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788651046.277502:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be765e6a00 x1875536408256256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651046.277522:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408256256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651046.881055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651046.881090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651046.881701:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349760 00000100:00100000:0.0:1788651046.881711:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349760 00000100:00100000:0.0:1788651046.881778:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:0.0:1788651046.881788:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389349760:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651046.881874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349632 00000100:00100000:0.0:1788651046.881876:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389349760:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 88us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651046.881880:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349632 00000100:00100000:0.0:1788651046.881885:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:1.0:1788651046.881921:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 199 00000100:00100000:1.0:1788651046.881930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389349632:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651046.881975:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389349632:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 47us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651046.881982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 199 00000100:00080000:3.0:1788651046.883682:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788651047.237368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651047.814439:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408256384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651047.814513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651047.814582:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256384 00000100:00100000:1.0:1788651047.814590:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256384 00000100:00100000:1.0:1788651047.814657:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788651047.814667:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408256384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651047.814704:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651047.814752:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408256384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651047.814760:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788651047.814804:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3f480 x1875536408256384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651047.814822:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408256384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651047.815469:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651048.268556:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651049.284561:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651050.308508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651050.886322:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408256512:0@lo:400:kworker.0 00000100:00100000:0.0:1788651050.886787:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651050.886837:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408257024:0@lo:400:kworker.0 00000100:00100000:1.0:1788651050.886856:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408256768:0@lo:400:kworker.0 00000100:00100000:1.0:1788651050.886887:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408256640:0@lo:400:kworker.0 00000100:00100000:0.0:1788651050.886889:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651050.886921:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651050.886938:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408256896:0@lo:400:kworker.0 00000100:00100000:1.0:1788651050.886942:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408257152:0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.886963:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651050.886970:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651050.886987:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257024 00000100:00100000:0.0:1788651050.886994:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257024 00000100:00100000:0.0:1788651050.887039:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256640 00000100:00100000:0.0:1788651050.887043:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256640 00000100:00100000:0.0:1788651050.887055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256768 00000100:00100000:0.0:1788651050.887057:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256768 00000100:00100000:0.0:1788651050.887086:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788651050.887196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408257024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.891933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788651050.891961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408256640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.892053:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408256640:12345-0@lo:400:kworker.0 Request processed in 105us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651050.892878:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788651050.892910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788651050.892919:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408256768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.892978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408256768:12345-0@lo:400:kworker.0 Request processed in 62us (6017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651050.892984:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788651050.893008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256512 00000100:00100000:3.0:1788651050.893015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256512 00000100:00100000:3.0:1788651050.893056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788651050.893814:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408256512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.893883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408256512:12345-0@lo:400:kworker.0 Request processed in 819us (7096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651050.893890:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788651050.893952:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408256768:0@lo:400:kworker.0 00000100:00080000:3.0:1788651050.894006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651050.894029:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408256512:0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.894820:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257152 00000100:00100000:3.0:1788651050.894830:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257152 00000100:00100000:3.0:1788651050.894890:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651050.894901:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651050.894964:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408257152:12345-0@lo:400:kworker.0 Request processed in 64us (7996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651050.894972:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788651050.894993:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651050.895036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651050.895282:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408256896 00000100:00100000:2.0:1788651050.895287:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408256896 00000100:00100000:2.0:1788651050.895318:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651050.895326:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408256896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651050.895378:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408256896:12345-0@lo:400:kworker.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651050.895384:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788651050.895398:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788651050.896274:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751cb100 x1875536408256896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651050.896289:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408256896:0@lo:400:kworker.0 00010000:00080000:1.0:1788651050.900831:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751c9f80 x1875536408257152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651050.900851:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408257152:0@lo:400:kworker.0 00000100:00100000:1.0:1788651050.900893:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408256640:0@lo:400:kworker.0 00000100:00100000:0.0:1788651050.904682:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408257024:12345-0@lo:400:kworker.0 Request processed in 17578us (17781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651050.904698:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788651050.905293:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408257024:0@lo:400:kworker.0 00010000:00010000:1.0:1788651051.333476:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651051.397634:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651051.397658:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408257280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651051.397731:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651051.397901:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257280 00000100:00100000:3.0:1788651051.397910:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257280 00000100:00100000:3.0:1788651051.397960:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651051.397970:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408257280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651051.398006:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651051.398061:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408257280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651051.398068:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788651051.398152:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be765e7100 x1875536408257280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651051.398172:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408257280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651051.996609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651051.996663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651051.996695:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350016 00000100:00100000:3.0:1788651051.996704:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350016 00000100:00100000:3.0:1788651051.996765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:3.0:1788651051.996776:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389350016:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651051.996848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389350016:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651051.996856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00080000:3.0:1788651051.996878:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651051.997330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389349888 00000100:00100000:1.0:1788651051.997337:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389349888 00000100:00100000:1.0:1788651051.997390:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00100000:1.0:1788651051.997399:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389349888:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651051.997441:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2353:x1875536389349888:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 44us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651051.997449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 201 00000001:02000400:3.0:1788651052.167359:0:10104:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:30:51 (1788651051) === 00010000:00010000:3.0:1788651052.356462:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651052.519502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651052.519580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350144 00000100:00100000:1.0:1788651052.519591:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350144 00000100:00100000:1.0:1788651052.519707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:1.0:1788651052.519741:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:8124:x1875536389350144:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788651052.519770:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651052.519788:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9d000/0x84a2fba8879772c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bf91 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651052.519815:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9d000/0x84a2fba8879772c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf91 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651052.519825:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9d000/0x84a2fba8879772c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf91 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651052.519834:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d000, rc 0) 00000100:00100000:1.0:1788651052.519901:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8124:x1875536389350144:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 162us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651052.519908:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:0.0:1788651052.525742:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.526151:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350272 00000100:00100000:3.0:1788651052.526175:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350272 00000100:00100000:3.0:1788651052.526232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:3.0:1788651052.526242:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8124:x1875536389350272:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788651052.526579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8124:x1875536389350272:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 336us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651052.526587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:3.0:1788651052.530147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651052.530292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350400 00000100:00100000:1.0:1788651052.530303:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350400 00000100:00100000:1.0:1788651052.530361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:1.0:1788651052.530371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8124:x1875536389350400:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788651052.530602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8124:x1875536389350400:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 231us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651052.530610:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:2.0:1788651052.540610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.541815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350528 00000100:00100000:0.0:1788651052.541829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350528 00000100:00100000:0.0:1788651052.541894:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:0.0:1788651052.541906:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8128:x1875536389350528:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788651052.542561:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8128:x1875536389350528:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 653us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.542572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:0.0:1788651052.563592:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.563823:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350656 00000100:00100000:3.0:1788651052.563837:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350656 00000100:00100000:3.0:1788651052.563925:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:3.0:1788651052.563938:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8128:x1875536389350656:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651052.564387:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8128:x1875536389350656:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 450us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651052.564396:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:3.0:1788651052.570961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.571308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350784 00000100:00100000:0.0:1788651052.571323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350784 00000100:00100000:0.0:1788651052.571399:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:0.0:1788651052.571411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:8124:x1875536389350784:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788651052.571431:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651052.571454:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40030200/0x84a2fba8879772cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bfbb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651052.571491:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40030200/0x84a2fba8879772cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfbb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651052.571504:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40030200/0x84a2fba8879772cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfbb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651052.571599:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40030200, rc 0) 00000100:00100000:0.0:1788651052.571733:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:8124:x1875536389350784:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 323us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.571741:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:2.0:1788651052.576457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651052.577635:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389350912 00000100:00100000:1.0:1788651052.577660:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389350912 00000100:00100000:1.0:1788651052.577753:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 208 00000100:00100000:1.0:1788651052.577764:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:8124:x1875536389350912:12345-192.168.203.21@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788651052.577798:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788651052.577835:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788651052.577840:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788651052.577844:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788651052.577847:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788651052.583294:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:8124:x1875536389350912:12345-192.168.203.21@tcp:256:mount.lustre.0 Request processed in 5513us (6834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651052.583315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 208 00000100:00100000:3.0:1788651052.588850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.589012:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351040 00000100:00100000:0.0:1788651052.589027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351040 00000100:00100000:0.0:1788651052.589160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:0.0:1788651052.589174:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:8124:x1875536389351040:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788651052.589197:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651052.589224:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bfc2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651052.589264:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651052.589278:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651052.589291:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40031e00, rc 0) 00000100:00100000:0.0:1788651052.589380:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8124:x1875536389351040:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 209us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.589388:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:2.0:1788651052.591912:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.592228:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351168 00000100:00100000:3.0:1788651052.592242:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351168 00000100:00100000:3.0:1788651052.592415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:3.0:1788651052.592428:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8124:x1875536389351168:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788651052.593808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8124:x1875536389351168:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 1371us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651052.593836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:2.0:1788651052.596697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651052.596780:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351296 00000100:00100000:1.0:1788651052.596793:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351296 00000100:00100000:1.0:1788651052.596928:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:1.0:1788651052.596941:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8124:x1875536389351296:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788651052.597328:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8124:x1875536389351296:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 389us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651052.597347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:3.0:1788651052.601370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.602296:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351424 00000100:00100000:0.0:1788651052.602314:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351424 00000100:00100000:0.0:1788651052.602534:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:0.0:1788651052.602550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8131:x1875536389351424:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788651052.602928:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8131:x1875536389351424:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 382us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.602938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:2.0:1788651052.610433:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.610995:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351552 00000100:00100000:0.0:1788651052.611017:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351552 00000100:00100000:0.0:1788651052.611084:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:0.0:1788651052.611097:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8131:x1875536389351552:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788651052.612641:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:8131:x1875536389351552:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 1283us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.612665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:0.0:1788651052.624822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.624970:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.625226:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351680 00000100:00100000:3.0:1788651052.625241:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351680 00000100:00100000:3.0:1788651052.625424:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352064 00000100:00100000:3.0:1788651052.625429:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352064 00000100:00100000:0.0:1788651052.625694:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:0.0:1788651052.625710:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389352064:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651052.625853:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1788651052.625861:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875536389351680:12345-192.168.203.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788651052.625894:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d7bda642-03c1-4a62-a15f-35e85e686a7f@192.168.203.21@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:1.0:1788651052.625951:0:5841:0:(genops.c:1385:class_connect()) connect: client d7bda642-03c1-4a62-a15f-35e85e686a7f, cookie 0x84a2fba8879772d9 00000004:00100000:1.0:1788651052.625995:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788651052.627028:0:5841:0:(import.c:65:import_set_state_nolock()) ffff93be7ff8b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651052.628664:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389352064:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 2939us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651052.628665:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2352:x1875536389351680:12345-192.168.203.21@tcp:38:mount.lustre.0 Request processed in 2786us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.628693:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:1.0:1788651052.628706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1788651052.642284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.642335:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651052.642399:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351808 00000100:00100000:0.0:1788651052.642414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351808 00000100:00100000:0.0:1788651052.642505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389351936 00000100:00080000:3.0:1788651052.642507:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651052.642510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389351936 00000100:00100000:1.0:1788651052.642914:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651052.642932:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+7:0:x1875536389351808:12345-192.168.203.21@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788651052.642936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1788651052.642951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+7:8124:x1875536389351936:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788651052.642999:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788651052.643157:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+7:8124:x1875536389351936:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 208us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.643182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000004:00000024:1.0:1788651052.644154:0:5871:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788651052.644295:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:0:x1875536389351808:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 1367us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651052.644318:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1788651052.652622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.654195:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352192 00000100:00100000:3.0:1788651052.654215:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352192 00000100:00100000:3.0:1788651052.654736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1788651052.654753:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:8124:x1875536389352192:12345-192.168.203.21@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788651052.654893:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:8124:x1875536389352192:12345-192.168.203.21@tcp:40:mount.lustre.0 Request processed in 144us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651052.654902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1788651052.660883:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651052.661104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651052.661611:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651052.661774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352576 00000100:00100000:3.0:1788651052.661786:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352576 00000100:00100000:3.0:1788651052.661855:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:3.0:1788651052.661869:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:8124:x1875536389352576:12345-192.168.203.21@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788651052.662167:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788651052.662278:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:8124:x1875536389352576:12345-192.168.203.21@tcp:33:mount.lustre.0 Request processed in 407us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651052.662289:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1788651052.668640:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352320 00000100:00100000:0.0:1788651052.669309:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352320 00000100:00100000:0.0:1788651052.669404:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352448 00000100:00100000:0.0:1788651052.669408:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352448 00000100:00100000:0.0:1788651052.669432:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1788651052.669444:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389352320:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788651052.669489:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d7bda642-03c1-4a62-a15f-35e85e686a7f@192.168.203.21@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1788651052.669536:0:6672:0:(genops.c:1385:class_connect()) connect: client d7bda642-03c1-4a62-a15f-35e85e686a7f, cookie 0x84a2fba8879772e0 00002000:00100000:0.0:1788651052.669553:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d7bda642-03c1-4a62-a15f-35e85e686a7f/ffff93be75633800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651052.669589:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651052.670094:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788651052.670170:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93be75630000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651052.670253:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2352:x1875536389352320:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 809us (9616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.670264:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1788651052.670296:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1788651052.670303:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389352448:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788651052.670327:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d7bda642-03c1-4a62-a15f-35e85e686a7f@192.168.203.21@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1788651052.670362:0:6672:0:(genops.c:1385:class_connect()) connect: client d7bda642-03c1-4a62-a15f-35e85e686a7f, cookie 0x84a2fba8879772e7 00002000:00100000:0.0:1788651052.670373:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d7bda642-03c1-4a62-a15f-35e85e686a7f/ffff93be75635000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651052.670382:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651052.670526:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788651052.670541:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93be75634800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651052.670573:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2352:x1875536389352448:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 269us (8963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651052.670579:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1788651052.932369:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651052.932393:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408257408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651052.932473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651052.932534:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257408 00000100:00100000:3.0:1788651052.932610:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257408 00000100:00100000:3.0:1788651052.932735:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651052.932746:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408257408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651052.932769:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651052.932824:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408257408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651052.932847:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788651052.932922:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3dc00 x1875536408257408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651052.932946:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408257408:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788651052.932995:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788651053.380384:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651054.405476:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788651055.018797:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7bda642-03c1-4a62-a15f-35e85e686a7f 00010000:00010000:1.0:1788651055.429821:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651056.007097:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408257792:0@lo:400:kworker.0 00000100:00100000:2.0:1788651056.007214:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651056.007276:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651056.007278:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408257536:0@lo:400:kworker.0 00000100:00100000:2.0:1788651056.007281:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408257920:0@lo:400:kworker.0 00000100:00100000:2.0:1788651056.007308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651056.007473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257792 00000100:00100000:2.0:1788651056.007480:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257792 00000100:00100000:1.0:1788651056.008158:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257920 00000100:00100000:1.0:1788651056.008164:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257920 00000100:00100000:2.0:1788651056.008505:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788651056.008527:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408257792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651056.008571:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651056.008590:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408257792:12345-0@lo:400:kworker.0 Request processed in 76us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651056.008597:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651056.008604:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408258048:0@lo:400:kworker.0 00000100:00100000:3.0:1788651056.008630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651056.008637:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408257792:0@lo:400:kworker.0 00000100:00100000:3.0:1788651056.008683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257536 00000100:00100000:3.0:1788651056.008687:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257536 00000100:00100000:0.0:1788651056.008702:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408257664:0@lo:400:kworker.0 00000100:00080000:0.0:1788651056.008729:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651056.008733:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651056.008745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258048 00000100:00100000:0.0:1788651056.008748:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258048 00000100:00100000:0.0:1788651056.008779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788651056.008785:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408258048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651056.008795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788651056.008824:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408258048:12345-0@lo:400:kworker.0 Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651056.008831:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788651056.008863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408257536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651056.008895:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408257536:12345-0@lo:400:kworker.0 Request processed in 94us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651056.008900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1788651056.008914:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651056.008938:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408257536:0@lo:400:kworker.0 00000100:00100000:0.0:1788651056.008948:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408258048:0@lo:400:kworker.0 00000100:00100000:0.0:1788651056.009008:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651056.009025:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408258176:0@lo:400:kworker.0 00000100:00100000:0.0:1788651056.009049:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651056.009490:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258176 00000100:00100000:2.0:1788651056.009495:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258176 00000100:00100000:1.0:1788651056.009580:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651056.009601:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408257664 00000100:00100000:3.0:1788651056.009606:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408257664 00000100:00100000:3.0:1788651056.009628:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788651056.009633:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408257664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651056.009669:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408257920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651056.009673:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408257664:12345-0@lo:400:kworker.0 Request processed in 40us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651056.009679:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788651056.009729:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788651056.009737:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788651056.009760:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651056.009768:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408257664:0@lo:400:kworker.0 00000100:00100000:0.0:1788651056.009893:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788651056.009906:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788651056.009913:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408258176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651056.009953:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408257920:12345-0@lo:400:kworker.0 Request processed in 362us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651056.009959:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788651056.010269:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556bb80 x1875536408257920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651056.010283:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408257920:0@lo:400:kworker.0 00000100:00100000:0.0:1788651056.011751:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408258176:12345-0@lo:400:kworker.0 Request processed in 1832us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651056.011763:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788651056.015022:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556b100 x1875536408258176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651056.015043:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408258176:0@lo:400:kworker.0 00000001:00100000:0.0:1788651056.029891:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d7bda642-03c1-4a62-a15f-35e85e686a7f 00000001:00100000:3.0:1788651056.035823:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7bda642-03c1-4a62-a15f-35e85e686a7f 00010000:00010000:2.0:1788651056.452616:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651056.519906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408258304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651056.519975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651056.520151:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258304 00000100:00100000:1.0:1788651056.520159:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258304 00000100:00100000:1.0:1788651056.520215:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788651056.520225:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408258304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651056.520262:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788651056.520422:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556bb80 x1875536408258304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651056.520441:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408258304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651056.520485:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408258304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 261us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651056.520493:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788651057.479792:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788651057.604884:0:10301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788651058.058718:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651058.058752:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408258432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651058.058848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651058.058985:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258432 00000100:00100000:1.0:1788651058.058996:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258432 00000100:00100000:1.0:1788651058.059084:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788651058.059096:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408258432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651058.059183:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651058.059244:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408258432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (395us total) trans 0 rc 0/0 00000100:00080000:2.0:1788651058.059350:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788651058.059415:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe3dc00 x1875536408258432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651058.059441:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408258432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651058.059510:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788651058.144393:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651058.144450:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651058.144481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651058.144509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651058.144540:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651058.144583:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353088 00000100:00100000:1.0:1788651058.144596:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353088 00000100:00100000:1.0:1788651058.144668:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353216 00000100:00100000:1.0:1788651058.144671:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353216 00000100:00100000:1.0:1788651058.144697:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1788651058.144709:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389353088:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651058.144801:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389353088:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651058.144809:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1788651058.144830:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:1.0:1788651058.144836:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389353216:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651058.144956:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352704 00000100:00100000:0.0:1788651058.144960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352704 00000100:00100000:0.0:1788651058.144995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:0.0:1788651058.145002:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389352704:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651058.145031:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389352704:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651058.145037:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:0.0:1788651058.145069:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352832 00000100:00100000:0.0:1788651058.145073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352832 00000100:00100000:0.0:1788651058.145104:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389352960 00000100:00100000:0.0:1788651058.145146:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389352960 00000100:00100000:0.0:1788651058.145176:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1788651058.145183:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389352832:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651058.145214:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389352832:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 33us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651058.145221:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1788651058.145234:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1788651058.145241:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389352960:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651058.145264:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389352960:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651058.145270:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1788651058.145497:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389353216:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 660us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651058.145505:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00080000:1.0:1788651058.145533:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651058.145538:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651058.145540:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651058.500768:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651059.525560:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651060.549708:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651061.125651:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408258944:0@lo:400:kworker.0 00000100:00100000:3.0:1788651061.125735:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651061.125799:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651061.125805:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408258816:0@lo:400:kworker.0 00000100:00100000:3.0:1788651061.125843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651061.126001:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408258688:0@lo:400:kworker.0 00000100:00100000:0.0:1788651061.126037:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651061.126059:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788651061.126081:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651061.126182:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408258560:0@lo:400:kworker.0 00000100:00100000:2.0:1788651061.126216:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651061.126267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258816 00000100:00100000:0.0:1788651061.126275:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258816 00000100:00100000:0.0:1788651061.126332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258688 00000100:00100000:0.0:1788651061.126335:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258688 00000100:00100000:0.0:1788651061.126356:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788651061.126365:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408258816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651061.126417:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408258816:12345-0@lo:400:kworker.0 Request processed in 52us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651061.126424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788651061.126440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788651061.126453:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408258688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651061.126486:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408258688:12345-0@lo:400:kworker.0 Request processed in 34us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651061.126492:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788651061.129470:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258944 00000100:00100000:1.0:1788651061.129495:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258944 00000100:00100000:1.0:1788651061.129560:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259200 00000100:00100000:1.0:1788651061.129564:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259200 00000100:00100000:1.0:1788651061.129589:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651061.129600:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408258944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651061.129679:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408259072:0@lo:400:kworker.0 00000100:00100000:1.0:1788651061.129687:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408258944:12345-0@lo:400:kworker.0 Request processed in 87us (3949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651061.129695:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788651061.129724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651061.129736:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788651061.129746:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408259200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651061.129775:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408258560 00000100:00100000:2.0:1788651061.129780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408258560 00000100:00100000:1.0:1788651061.129785:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408259200:12345-0@lo:400:kworker.0 Request processed in 40us (3701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651061.129792:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651061.129815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788651061.129823:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408258560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651061.129845:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259072 00000100:00100000:1.0:1788651061.129851:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259072 00000100:00100000:2.0:1788651061.129862:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408258560:12345-0@lo:400:kworker.0 Request processed in 40us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651061.129870:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788651061.129886:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788651061.129895:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408259072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651061.129937:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408258560:0@lo:400:kworker.0 00000100:00080000:0.0:1788651061.131800:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651061.131808:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651061.131811:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651061.131882:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408259072:12345-0@lo:400:kworker.0 Request processed in 1985us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651061.131893:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788651061.131898:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408258816:0@lo:400:kworker.0 00010000:00080000:1.0:1788651061.131922:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751c8e00 x1875536408258944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651061.131933:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408259072:0@lo:400:kworker.0 00000100:00100000:1.0:1788651061.131935:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408258944:0@lo:400:kworker.0 00000100:00100000:2.0:1788651061.132008:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408258688:0@lo:400:kworker.0 00010000:00080000:2.0:1788651061.132032:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be77b80 x1875536408259200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651061.132041:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408259200:0@lo:400:kworker.0 00010000:00010000:3.0:1788651061.575340:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651061.636460:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651061.636484:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408259328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651061.636556:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651061.636665:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259328 00000100:00100000:2.0:1788651061.636673:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259328 00000100:00100000:2.0:1788651061.636756:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651061.636767:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408259328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651061.636801:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651061.636858:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408259328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651061.636865:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788651061.636943:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7556bb80 x1875536408259328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651061.636963:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408259328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788651062.597006:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651063.175095:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408259456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651063.175208:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651063.175248:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259456 00000100:00100000:0.0:1788651063.175258:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259456 00000100:00100000:0.0:1788651063.175330:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788651063.175341:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408259456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788651063.175364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788651063.175375:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651063.175430:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408259456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651063.175436:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788651063.175721:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be75875180 x1875536408259456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651063.175739:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408259456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651063.272678:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651063.272739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651063.272775:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651063.272794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651063.272812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651063.272838:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353856 00000100:00100000:3.0:1788651063.272847:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353856 00000100:00100000:3.0:1788651063.272905:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353728 00000100:00100000:3.0:1788651063.272909:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353728 00000100:00100000:3.0:1788651063.272938:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1788651063.272949:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389353856:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651063.273025:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389353856:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651063.273054:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1788651063.273076:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:3.0:1788651063.273085:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389353728:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651063.273137:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389353728:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651063.273144:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00080000:3.0:1788651063.273167:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651063.273172:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651063.273314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353600 00000100:00100000:3.0:1788651063.273320:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353600 00000100:00100000:3.0:1788651063.273355:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353472 00000100:00100000:3.0:1788651063.273359:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353472 00000100:00100000:3.0:1788651063.273387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1788651063.273398:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389353600:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651063.273437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389353600:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 44us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651063.273444:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1788651063.273460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:3.0:1788651063.273469:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389353472:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651063.273506:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389353472:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 39us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651063.273512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00080000:3.0:1788651063.273560:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651063.274739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353344 00000100:00100000:0.0:1788651063.274748:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353344 00000100:00100000:0.0:1788651063.274789:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00100000:0.0:1788651063.274798:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389353344:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651063.274855:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389353344:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 57us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651063.274863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 217 00010000:00010000:3.0:1788651063.623931:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651064.644930:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651065.670952:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651066.244656:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408259840:0@lo:400:kworker.0 00000100:00100000:2.0:1788651066.244755:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651066.244826:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651066.244841:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408259968:0@lo:400:kworker.0 00000100:00100000:2.0:1788651066.244867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651066.244944:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408259712:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.244992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651066.245023:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408260224:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651066.245080:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788651066.245085:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408259584:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245133:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651066.245153:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408260096:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245173:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651066.245204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259584 00000100:00100000:1.0:1788651066.245214:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259584 00000100:00100000:1.0:1788651066.245295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788651066.245306:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245362:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408259584:12345-0@lo:400:kworker.0 Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651066.245370:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788651066.245407:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259840 00000100:00100000:1.0:1788651066.245411:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259840 00000100:00100000:1.0:1788651066.245447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259712 00000100:00100000:1.0:1788651066.245450:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259712 00000100:00100000:1.0:1788651066.245461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260096 00000100:00100000:1.0:1788651066.245463:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260096 00000100:00100000:1.0:1788651066.245477:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651066.245484:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408259840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245524:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408259840:12345-0@lo:400:kworker.0 Request processed in 40us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651066.245530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651066.245543:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788651066.245555:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408259712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245587:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408259712:12345-0@lo:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651066.245593:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788651066.245603:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788651066.245609:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245635:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408260096:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651066.245641:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788651066.245686:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408259584:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245701:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408260096:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245710:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408259712:0@lo:400:kworker.0 00000100:00100000:1.0:1788651066.245744:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408259840:0@lo:400:kworker.0 00000100:00100000:3.0:1788651066.245922:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408259968 00000100:00100000:3.0:1788651066.245935:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408259968 00000100:00100000:3.0:1788651066.245974:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260224 00000100:00100000:3.0:1788651066.245977:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260224 00000100:00100000:3.0:1788651066.245999:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788651066.246007:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651066.246044:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408259968:12345-0@lo:400:kworker.0 Request processed in 40us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651066.246050:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788651066.246061:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788651066.246066:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408260224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651066.246090:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408260224:12345-0@lo:400:kworker.0 Request processed in 25us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651066.246096:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788651066.246133:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651066.246136:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651066.246139:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651066.246160:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be75569500 x1875536408259968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651066.246177:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408259968:0@lo:400:kworker.0 00010000:00080000:3.0:1788651066.246197:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be77b80 x1875536408260224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651066.246206:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408260224:0@lo:400:kworker.0 00010000:00010000:3.0:1788651066.692287:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651066.756504:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651066.756537:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408260352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651066.756630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651066.756839:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260352 00000100:00100000:1.0:1788651066.756850:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260352 00000100:00100000:1.0:1788651066.756903:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788651066.756913:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408260352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651066.756958:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651066.757016:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408260352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651066.757023:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788651066.757663:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be751cb100 x1875536408260352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651066.757687:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408260352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788651067.717187:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651068.293085:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651068.293126:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408260480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651068.293283:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651068.293702:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260480 00000100:00100000:1.0:1788651068.293713:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260480 00000100:00100000:1.0:1788651068.293793:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788651068.293802:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408260480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651068.293838:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651068.293889:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408260480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651068.293896:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788651068.293939:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d402d80 x1875536408260480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651068.293958:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408260480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651068.294026:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651068.386795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651068.386853:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651068.386882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651068.386904:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651068.386979:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651068.387014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354112 00000100:00100000:2.0:1788651068.387028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354112 00000100:00100000:2.0:1788651068.387084:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354240 00000100:00100000:2.0:1788651068.387088:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354240 00000100:00100000:1.0:1788651068.387204:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1788651068.387219:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389354112:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651068.387302:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389354112:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 88us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651068.387310:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1788651068.387328:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:1.0:1788651068.387334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389354240:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651068.387356:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389354240:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651068.387363:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00080000:2.0:1788651068.387511:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651068.388215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389353984 00000100:00100000:3.0:1788651068.388222:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389353984 00000100:00100000:1.0:1788651068.388252:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354368 00000100:00100000:1.0:1788651068.388258:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354368 00000100:00100000:3.0:1788651068.388283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:3.0:1788651068.388294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389353984:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651068.388299:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354496 00000100:00100000:1.0:1788651068.388304:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354496 00000100:00100000:1.0:1788651068.388336:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1788651068.388345:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389354368:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651068.388351:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389353984:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 58us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651068.388363:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:1.0:1788651068.388388:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389354368:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 44us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651068.388397:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1788651068.388412:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1788651068.388418:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389354496:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651068.388441:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389354496:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651068.388448:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00080000:2.0:1788651068.389171:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651068.389177:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651068.741272:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651069.768724:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651070.788421:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651071.364560:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408260608:0@lo:400:kworker.0 00000100:00100000:0.0:1788651071.364614:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408260736:0@lo:400:kworker.0 00000100:00100000:1.0:1788651071.364634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651071.364647:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651071.364676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788651071.364698:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651071.364721:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260736 00000100:00100000:2.0:1788651071.364729:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260736 00000100:00100000:1.0:1788651071.364732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260608 00000100:00100000:1.0:1788651071.364735:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260608 00000100:00100000:2.0:1788651071.364765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408261120 00000100:00100000:2.0:1788651071.364768:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408261120 00000100:00100000:1.0:1788651071.364768:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788651071.364775:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408260608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651071.364791:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788651071.364796:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408260736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651071.364821:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408260608:12345-0@lo:400:kworker.0 Request processed in 45us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651071.364827:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408260736:12345-0@lo:400:kworker.0 Request processed in 32us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651071.364827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788651071.364832:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788651071.364842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788651071.364847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408261120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651071.364870:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408261120:12345-0@lo:400:kworker.0 Request processed in 23us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651071.364871:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408260608:0@lo:400:kworker.0 00000100:00100000:2.0:1788651071.364876:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788651071.364883:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408261120:0@lo:400:kworker.0 00000100:00080000:2.0:1788651071.364893:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651071.365856:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408260736:0@lo:400:kworker.0 00000100:00100000:0.0:1788651071.365867:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408261248:0@lo:400:kworker.0 00000100:00100000:0.0:1788651071.365903:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651071.365986:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408260864:0@lo:400:kworker.0 00000100:00100000:0.0:1788651071.366024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651071.366042:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651071.366048:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408260992:0@lo:400:kworker.0 00000100:00100000:0.0:1788651071.366069:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651071.366127:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260864 00000100:00100000:1.0:1788651071.366140:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260864 00000100:00100000:1.0:1788651071.366179:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788651071.366186:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408260864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651071.366234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408260864:12345-0@lo:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651071.366241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788651071.366257:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651071.366893:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408260864:0@lo:400:kworker.0 00000100:00100000:3.0:1788651071.369968:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408261248 00000100:00100000:3.0:1788651071.370282:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408261248 00000100:00100000:3.0:1788651071.370419:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408260992 00000100:00100000:3.0:1788651071.370423:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408260992 00000100:00080000:2.0:1788651071.370610:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651071.370615:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651071.370739:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788651071.370749:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651071.370768:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788651071.370777:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408260992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651071.371947:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408260992:12345-0@lo:400:kworker.0 Request processed in 1166us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651071.371957:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788651071.372239:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be75875880 x1875536408260992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651071.372254:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408260992:0@lo:400:kworker.0 00000100:00100000:3.0:1788651071.372368:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408261248:12345-0@lo:400:kworker.0 Request processed in 1620us (6462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651071.372376:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788651071.373941:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be75877480 x1875536408261248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651071.373958:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408261248:0@lo:400:kworker.0 00010000:00010000:1.0:1788651071.812377:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651071.885713:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408261376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651071.885793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651071.886089:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408261376 00000100:00100000:1.0:1788651071.886098:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408261376 00000100:00100000:1.0:1788651071.886179:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788651071.886189:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408261376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651071.886235:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651071.886281:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408261376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651071.886288:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788651071.886359:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe95500 x1875536408261376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651071.886378:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408261376:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788651072.551042:0:11001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788651072.837348:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651073.415485:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408261504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651073.415602:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651073.417149:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408261504 00000100:00100000:3.0:1788651073.417166:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408261504 00000100:00100000:3.0:1788651073.417272:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788651073.417286:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408261504:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651073.417287:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788651073.417345:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651073.418416:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408261504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1125us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651073.418445:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788651073.419052:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d402300 x1875536408261504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651073.419084:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408261504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651073.501417:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651073.501474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651073.501509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651073.501537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651073.501584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651073.501620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354880 00000100:00100000:0.0:1788651073.501632:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354880 00000100:00100000:0.0:1788651073.501705:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354752 00000100:00100000:0.0:1788651073.501708:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354752 00000100:00100000:0.0:1788651073.501737:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:0.0:1788651073.501750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389354880:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651073.501856:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389354880:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651073.501865:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:0.0:1788651073.501886:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:0.0:1788651073.501893:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389354752:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651073.501920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389354752:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 28us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651073.501926:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:0.0:1788651073.501946:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355008 00000100:00100000:0.0:1788651073.501950:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355008 00000100:00100000:0.0:1788651073.501981:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355136 00000100:00100000:0.0:1788651073.501984:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355136 00000100:00100000:0.0:1788651073.502006:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1788651073.502013:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2352:x1875536389355008:12345-192.168.203.21@tcp:9:kworker.0 00000100:00100000:3.0:1788651073.502039:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000020:00000080:0.0:1788651073.502048:0:6672:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879772e0 00000100:00100000:3.0:1788651073.502049:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2352:x1875536389355136:12345-192.168.203.21@tcp:9:kworker.0 00000100:00080000:0.0:1788651073.502058:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93be75630000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788651073.502061:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879772e7 00000100:00080000:3.0:1788651073.502073:0:6674:0:(import.c:65:import_set_state_nolock()) ffff93be75634800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788651073.502104:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:0.0:1788651073.502104:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788651073.502559:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389354624 00000100:00100000:1.0:1788651073.502564:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389354624 00000100:00100000:1.0:1788651073.502610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 221 00000100:00100000:1.0:1788651073.502618:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389354624:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651073.502660:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+2:2352:x1875536389355008:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 645us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651073.502666:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00080000:0.0:1788651073.502688:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651073.502692:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651073.502695:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788651073.505215:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651073.506926:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+2:2352:x1875536389355136:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 4863us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651073.506942:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389354624:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 4323us (5536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651073.506943:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:1.0:1788651073.506952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 221 00010000:00010000:0.0:1788651073.508617:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651073.862360:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651074.884626:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788651075.543824:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d7bda642-03c1-4a62-a15f-35e85e686a7f 00000020:00000080:3.0:1788651075.543838:0:6698:0:(genops.c:885:class_export_put()) final put ffff93be75633800/d7bda642-03c1-4a62-a15f-35e85e686a7f 00000020:00000080:2.0:1788651075.544902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be75633800/d7bda642-03c1-4a62-a15f-35e85e686a7f for lustre-OST0000 00000020:00000080:2.0:1788651075.552767:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be75630000 for lustre-OST0000 00000020:00000080:3.0:1788651075.602490:0:11149:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe045a58f0 20000000:00000080:3.0:1788651075.602516:0:11149:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93be7bfda000 uarg=0000000000000000 20000000:01000000:3.0:1788651075.602569:0:11149:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788651075.602576:0:11149:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788651075.602582:0:11149:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788651075.603644:0:11150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788651075.603847:0:11149:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788651075.612467:0:11149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788651075.612671:0:11149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612697:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612707:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797729a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612714:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612720:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612744:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612753:0:11149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612809:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.612828:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 12 pid: 5833 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.612847:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408261632:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651075.613039:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613048:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 18 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.613058:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408261760:0@lo:104: 00000100:00100000:3.0:1788651075.613327:0:11149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651075.613386:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408261760 00000100:00100000:3.0:1788651075.613396:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408261760 00000100:00100000:3.0:1788651075.613456:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651075.613467:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11149:x1875536408261760:12345-0@lo:104: 00010000:00010000:3.0:1788651075.613485:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613558:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651075.613565:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11149:x1875536408261760:12345-0@lo:104: Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651075.613573:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788651075.613600:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651075.613607:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613615:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651075.613620:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613630:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651075.613638:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651075.613644:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651075.613678:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613685:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651075.613707:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613715:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879772b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613739:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651075.613741:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651075.613743:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651075.613767:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408261888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651075.613802:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651075.613848:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613859:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 18 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.613868:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408262016:0@lo:104: 00000100:00100000:3.0:1788651075.613891:0:11149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651075.613911:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262016 00000100:00100000:3.0:1788651075.613915:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262016 00000100:00100000:3.0:1788651075.613931:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651075.613937:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11149:x1875536408262016:12345-0@lo:104: 00010000:00010000:3.0:1788651075.613946:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.613991:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651075.613996:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11149:x1875536408262016:12345-0@lo:104: Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651075.614002:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788651075.614016:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651075.614021:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614038:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651075.614042:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614049:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651075.614055:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651075.614061:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651075.614097:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614130:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651075.614140:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614147:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be4618b400/0x84a2fba8879772a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614157:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651075.614159:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651075.614161:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651075.614283:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651075.614293:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408262144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651075.614323:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651075.614351:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408261888 00000100:00100000:3.0:1788651075.614355:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408261888 00010000:00010000:3.0:1788651075.614381:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 19 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.614404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262144 00000100:00100000:3.0:1788651075.614407:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262144 00010000:00010000:3.0:1788651075.614419:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 20 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.614431:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651075.614437:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be460a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3308:x1875536408261888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651075.614449:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651075.614456:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 20 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614467:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 20 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614485:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651075.614514:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be460a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3308:x1875536408261888:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651075.614521:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651075.614569:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651075.614576:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408262144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651075.614583:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651075.614587:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 19 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614595:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 19 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614615:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651075.614636:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408262144:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651075.614643:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651075.614682:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408262144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651075.614692:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408261888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651075.614728:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797729a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614738:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797729a expref: 18 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.614746:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d403480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408262272:0@lo:104: 00000100:00100000:3.0:1788651075.614768:0:11149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651075.614789:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262272 00000100:00100000:3.0:1788651075.614793:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262272 00000100:00100000:3.0:1788651075.614809:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651075.614815:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11149:x1875536408262272:12345-0@lo:104: 00010000:00010000:3.0:1788651075.614824:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614855:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651075.614860:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11149:x1875536408262272:12345-0@lo:104: Request processed in 46us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651075.614866:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788651075.614896:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.614914:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 12 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.614926:0:11149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d403b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408262400:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651075.614973:0:11149:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788651075.614986:0:11149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9de00/0x84a2fba8879772bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879772b6 expref: 18 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.614996:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408261760:0@lo:104: 00010000:00010000:3.0:1788651075.615005:0:11149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a400/0x84a2fba8879772af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879772a8 expref: 17 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651075.615013:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408262016:0@lo:104: 00000100:00100000:3.0:1788651075.615019:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d403480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408262272:0@lo:104: 00010000:00010000:2.0:1788651075.615375:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651075.615384:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615392:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1788651075.615396:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615405:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651075.615412:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651075.615418:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788651075.615450:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615457:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651075.615480:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615487:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c800/0x84a2fba88797729a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879772a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615517:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651075.615518:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651075.615520:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651075.615533:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408262528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788651075.615571:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651075.615610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262528 00000100:00100000:2.0:1788651075.615614:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262528 00010000:00010000:2.0:1788651075.615635:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797729a expref: 17 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651075.615656:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788651075.615664:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:3306:x1875536408262528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651075.615673:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651075.615677:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797729a expref: 17 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615687:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797729a expref: 17 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615699:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618b800/0x84a2fba8879772a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797729a expref: 17 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.615709:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651075.615739:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3306:x1875536408262528:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651075.615746:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788651075.615773:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408262528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651075.621843:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408261632:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651075.624593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651075.624728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651075.624839:0:11149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d403b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1875536408262400:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651075.624887:0:11149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651075.625060:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355264 00000100:00100000:2.0:1788651075.625070:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355264 00000100:00100000:3.0:1788651075.626880:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355392 00000100:00100000:3.0:1788651075.626897:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355392 00010000:00010000:3.0:1788651075.627448:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 14 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.627448:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 14 pid: 5833 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651075.628221:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1788651075.628244:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+14:2355:x1875536389355392:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651075.628267:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651075.628276:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 14 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628290:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 14 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628314:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030800/0x84a2fba887977293 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf8a expref: 14 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628333:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651075.628393:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788651075.628404:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788651075.628424:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389355392:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 191us (3695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651075.628432:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1788651075.628456:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1788651075.628465:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:2356:x1875536389355264:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651075.628471:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651075.628474:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 12 pid: 5833 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628481:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 12 pid: 5833 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628510:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40031e00/0x84a2fba8879772d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfc2 expref: 12 pid: 5833 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628524:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628533:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628550:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628558:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628570:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628578:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628584:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429caa00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651075.628589:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628598:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628620:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651075.628645:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651075.628651:0:11149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651075.628666:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:2356:x1875536389355264:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 203us (4084us total) trans 0 rc 0/0 00010000:00010000:3.0:1788651075.628667:0:11149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651075.628672:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00010000:00010000:3.0:1788651075.628674:0:11149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429caa00/0x84a2fba8879772ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651075.908399:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651076.486564:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408262784:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.486686:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408262656:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.486746:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651076.486797:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408263168:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.486824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651076.486853:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651076.486859:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408263040:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.486883:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651076.486911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408262912:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.486935:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651076.486974:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263168 00000100:00100000:2.0:1788651076.486982:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263168 00000100:00100000:2.0:1788651076.487055:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262912 00000100:00100000:2.0:1788651076.487060:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262912 00000100:00100000:1.0:1788651076.487070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262656 00000100:00100000:1.0:1788651076.487084:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262656 00000100:00100000:2.0:1788651076.487093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788651076.487148:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408263168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651076.487184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788651076.487199:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3307:x1875536408262656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.487224:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408263168:12345-0@lo:400:kworker.0 Request processed in 120us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651076.487233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788651076.487256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788651076.487267:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408262912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651076.487283:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3307:x1875536408262656:12345-0@lo:400:kworker.0 Request processed in 88us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651076.487293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788651076.487327:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408262912:12345-0@lo:400:kworker.0 Request processed in 60us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651076.487348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788651076.487751:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651076.487777:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408263296:0@lo:400:kworker.0 00000100:00100000:3.0:1788651076.487804:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651076.487838:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263040 00000100:00100000:3.0:1788651076.487843:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263040 00000100:00100000:3.0:1788651076.487877:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263296 00000100:00100000:3.0:1788651076.487880:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263296 00000100:00100000:3.0:1788651076.487900:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788651076.487907:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408263040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651076.487945:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408263040:12345-0@lo:400:kworker.0 Request processed in 38us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651076.487952:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788651076.487965:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788651076.487973:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408263296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.488150:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408262784 00000100:00100000:2.0:1788651076.488155:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408262784 00000100:00100000:2.0:1788651076.488204:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788651076.488217:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408262784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651076.488379:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408263296:12345-0@lo:400:kworker.0 Request processed in 406us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651076.488398:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788651076.489458:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408262784:12345-0@lo:400:kworker.0 Request processed in 1242us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651076.489469:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788651076.489500:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651076.489503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651076.489506:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651076.489553:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408262912:0@lo:400:kworker.0 00010000:00080000:2.0:1788651076.489704:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d400380 x1875536408263040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651076.489716:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408263040:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.489726:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408262656:0@lo:400:kworker.0 00000100:00100000:2.0:1788651076.489736:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408263168:0@lo:400:kworker.0 00000100:00100000:0.0:1788651076.492882:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408262784:0@lo:400:kworker.0 00010000:00080000:0.0:1788651076.492909:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d400000 x1875536408263296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651076.492922:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408263296:0@lo:400:kworker.0 00000001:00100000:0.0:1788651076.558461:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d7bda642-03c1-4a62-a15f-35e85e686a7f 00000020:00000080:0.0:1788651076.558475:0:7633:0:(genops.c:885:class_export_put()) final put ffff93be75635000/d7bda642-03c1-4a62-a15f-35e85e686a7f 00000020:00000080:1.0:1788651076.558567:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be75635000/d7bda642-03c1-4a62-a15f-35e85e686a7f for lustre-OST0001 00000020:00000080:1.0:1788651076.558634:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be75634800 for lustre-OST0001 00010000:00010000:2.0:1788651076.934083:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651076.955968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651076.956066:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355520 00000100:00100000:1.0:1788651076.956076:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355520 00000100:00100000:1.0:1788651076.956162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 223 00000100:00100000:1.0:1788651076.956181:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:5593:x1875536389355520:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651076.956197:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651076.956216:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bfec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651076.956243:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651076.956254:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651076.956275:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9ca00, rc 0) 00000100:00100000:1.0:1788651076.956333:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389355520:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651076.956340:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 223 00000100:00100000:2.0:1788651076.971309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651076.971400:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355648 00000100:00100000:1.0:1788651076.971410:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355648 00000100:00100000:1.0:1788651076.971471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:1.0:1788651076.971481:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389355648:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651076.971835:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389355648:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 354us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651076.971842:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:1.0:1788651076.986768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651076.986933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355776 00000100:00100000:2.0:1788651076.986943:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355776 00000100:00100000:2.0:1788651076.986998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 225 00000100:00100000:2.0:1788651076.987009:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389355776:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651076.987258:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389355776:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 250us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651076.987273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 225 00000100:00100000:2.0:1788651076.996341:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408263424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651076.996411:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651076.996512:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263424 00000100:00100000:0.0:1788651076.996521:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263424 00000100:00100000:0.0:1788651076.996572:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788651076.996581:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408263424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651076.996617:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651077.002393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651077.002624:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408263424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6040us (6208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651077.002645:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788651077.006227:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe95c00 x1875536408263424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651077.006257:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408263424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651077.006304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389355904 00000100:00100000:2.0:1788651077.006311:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389355904 00000100:00100000:2.0:1788651077.006373:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 226 00000100:00100000:2.0:1788651077.006385:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389355904:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651077.006400:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651077.006419:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bff3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.007441:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.007456:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.007534:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a800, rc 0) 00000100:00100000:2.0:1788651077.007607:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389355904:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 1223us (5223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651077.007615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 226 00000100:00100000:2.0:1788651077.009924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651077.010036:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356032 00000100:00100000:3.0:1788651077.010052:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356032 00000100:00100000:3.0:1788651077.010191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 227 00000100:00100000:3.0:1788651077.010202:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389356032:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.011880:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389356032:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 1671us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651077.011892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 227 00000100:00100000:2.0:1788651077.017636:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651077.017718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356160 00000100:00100000:3.0:1788651077.017729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356160 00000100:00100000:3.0:1788651077.017819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 228 00000100:00100000:3.0:1788651077.017829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389356160:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.018042:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389356160:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 214us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651077.018051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 228 10000000:01000000:3.0:1788651077.508242:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651077.508249:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93bd412bd800 from 7 10000000:01000000:3.0:1788651077.508254:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651077.508301:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.508314:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.508325:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651077.508355:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.508422:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651077.508519:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651077.512417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263552 00000100:00100000:0.0:1788651077.512435:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263552 00000100:00100000:0.0:1788651077.512499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788651077.512509:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408263552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651077.512526:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651077.512544:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977303 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651077.512574:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977303 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651077.512585:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977303 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651077.512595:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40030800, rc 0) 00000100:00100000:0.0:1788651077.512670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408263552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651077.512676:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788651077.512893:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651077.512915:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.512925:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651077.512999:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.513035:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651077.513161:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651077.515251:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263680 00000100:00100000:0.0:1788651077.515265:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263680 00000100:00100000:0.0:1788651077.515324:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788651077.515334:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408263680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651077.515667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408263680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651077.515674:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788651077.520605:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.524080:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.524437:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651077.524471:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788651077.525226:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263808 00000100:00100000:0.0:1788651077.525242:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263808 00000100:00100000:0.0:1788651077.525286:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788651077.525296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408263808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651077.525502:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408263808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651077.525510:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788651077.525629:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788651077.528485:0:11253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788651077.528592:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788651077.528614:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651077.528626:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.528639:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651077.528650:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651077.528653:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7bfe0800 from 7 10000000:01000000:3.0:1788651077.528655:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651077.528763:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.528772:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.528782:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651077.528823:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.528885:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651077.529029:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651077.529070:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408263936 00000100:00100000:2.0:1788651077.529081:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408263936 00000100:00100000:2.0:1788651077.529145:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788651077.529155:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408263936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651077.529227:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651077.529241:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887977311 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.529264:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887977311 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.529275:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977311 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.529284:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a200, rc 0) 00000100:00100000:2.0:1788651077.529328:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408263936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651077.529335:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788651077.529403:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408263936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651077.529416:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.529425:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651077.529472:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.529495:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651077.529535:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264064 00000100:00100000:2.0:1788651077.529539:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264064 00000100:00100000:2.0:1788651077.529567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788651077.529574:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408264064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.529795:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408264064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651077.529802:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788651077.529848:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651077.529860:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.529883:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.529918:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651077.529937:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651077.529980:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264192 00000100:00100000:2.0:1788651077.529984:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264192 00000100:00100000:2.0:1788651077.530010:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788651077.530017:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408264192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.530190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408264192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651077.530197:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788651077.530231:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788651077.532393:0:11254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788651077.532692:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788651077.532711:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651077.532722:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.532733:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651077.532743:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788651077.532745:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be4384a800 from 7 10000000:01000000:2.0:1788651077.532748:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788651077.532780:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.532789:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.532825:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651077.532849:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.532908:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651077.532946:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67000 going to sleep for 11 seconds 00000100:00100000:3.0:1788651077.532952:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264320 00000100:00100000:3.0:1788651077.532958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264320 00000100:00100000:3.0:1788651077.533001:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788651077.533010:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408264320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651077.533032:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651077.533047:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797731f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.533081:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797731f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.533090:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797731f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.533098:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cbc00, rc 0) 00000100:00100000:3.0:1788651077.533305:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408264320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651077.533311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788651077.533514:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651077.533529:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651077.533539:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651077.533589:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.533613:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651077.533640:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67000 going to sleep for 11 seconds 00000100:00100000:3.0:1788651077.533647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264448 00000100:00100000:3.0:1788651077.533651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264448 00000100:00100000:3.0:1788651077.533679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788651077.533687:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408264448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.533916:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408264448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651077.533922:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788651077.534242:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.534274:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651077.534314:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651077.534342:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67000 going to sleep for 11 seconds 00000100:00100000:3.0:1788651077.534345:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264576 00000100:00100000:3.0:1788651077.534349:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264576 00000100:00100000:3.0:1788651077.534380:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788651077.534387:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408264576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651077.534526:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408264576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651077.534532:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788651077.534577:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408264576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788651077.535450:0:11255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788651077.535508:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788651077.535521:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651077.535538:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651077.535549:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651077.957617:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651078.536248:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651078.536271:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408264704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651078.536346:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651078.536448:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264704 00000100:00100000:3.0:1788651078.536457:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264704 00000100:00100000:3.0:1788651078.536520:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788651078.536529:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408264704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651078.536562:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651078.536610:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408264704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651078.536618:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788651078.536659:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d400000 x1875536408264704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651078.536676:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408264704:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651078.536737:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651078.620480:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651078.620536:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651078.620599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356288 00000100:00100000:0.0:1788651078.620609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356288 00000100:00100000:0.0:1788651078.620661:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:0.0:1788651078.620671:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389356288:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651078.620735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389356288:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 66us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651078.620742:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:3.0:1788651078.621022:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356544 00000100:00100000:3.0:1788651078.621027:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356544 00000100:00100000:3.0:1788651078.621140:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:3.0:1788651078.621149:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389356544:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651078.621196:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389356544:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 49us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651078.621203:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00080000:2.0:1788651078.621334:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651078.621369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651078.621671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356416 00000100:00100000:3.0:1788651078.621677:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356416 00000100:00100000:3.0:1788651078.621725:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:3.0:1788651078.621741:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389356416:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651078.621851:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389356416:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651078.621859:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00080000:2.0:1788651078.622081:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788651078.724790:0:11349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788651078.984832:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651080.005444:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651081.032195:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651081.604423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408264832:0@lo:400:kworker.0 00000100:00100000:0.0:1788651081.604486:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408265216:0@lo:400:kworker.0 00000100:00100000:3.0:1788651081.604514:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651081.606398:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408264960:0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.606624:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408265088:0@lo:400:kworker.0 00000100:00100000:3.0:1788651081.607858:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408265344:0@lo:400:kworker.0 00000100:00100000:3.0:1788651081.608034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651081.608080:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264832 00000100:00100000:3.0:1788651081.608087:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264832 00000100:00100000:3.0:1788651081.608155:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788651081.608164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408264832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651081.613944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651081.614008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651081.614078:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788651081.614154:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651081.614247:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265216 00000100:00100000:1.0:1788651081.614577:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265216 00000100:00100000:1.0:1788651081.614648:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265472 00000100:00100000:1.0:1788651081.614650:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265472 00000100:00100000:1.0:1788651081.614672:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788651081.614698:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651081.614888:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408265216:12345-0@lo:400:kworker.0 Request processed in 190us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651081.614902:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788651081.614925:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408265472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.614976:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265344 00000100:00100000:2.0:1788651081.614983:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265344 00000100:00100000:3.0:1788651081.615022:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408265472:12345-0@lo:400:kworker.0 Request processed in 108us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651081.615030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408264960 00000100:00100000:2.0:1788651081.615035:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408264960 00000100:00100000:2.0:1788651081.615059:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788651081.615067:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408265344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.615134:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408265344:12345-0@lo:400:kworker.0 Request processed in 68us (7100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651081.615151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788651081.615170:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788651081.615178:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408264960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.615209:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408264960:12345-0@lo:400:kworker.0 Request processed in 33us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651081.615215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788651081.615396:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788651081.615419:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651081.615424:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651081.615427:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651081.615470:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408264960:0@lo:400:kworker.0 00010000:00080000:1.0:1788651081.615487:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d3a2300 x1875536408265472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651081.615499:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408265472:0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.615996:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651081.616026:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265088 00000100:00100000:2.0:1788651081.616031:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265088 00000100:00100000:2.0:1788651081.616079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788651081.616086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.616154:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408265088:12345-0@lo:400:kworker.0 Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651081.616161:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788651081.616193:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408265088:0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.616236:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408265344:0@lo:400:kworker.0 00000100:00100000:2.0:1788651081.617078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408264832:12345-0@lo:400:kworker.0 Request processed in 8911us (12562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651081.617089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788651081.617170:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408264832:0@lo:400:kworker.0 00000100:00080000:1.0:1788651081.619246:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788651081.624623:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d3a0700 x1875536408265216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651081.624646:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408265216:0@lo:400:kworker.0 00000100:00100000:3.0:1788651081.625347:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788651082.057510:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651082.116936:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651082.116958:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408265600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651082.117018:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651082.117076:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265600 00000100:00100000:3.0:1788651082.117083:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265600 00000100:00100000:3.0:1788651082.117151:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788651082.117160:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408265600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651082.117202:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651082.117244:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408265600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651082.117251:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788651082.117655:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d402300 x1875536408265600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651082.117673:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408265600:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788651082.442503:0:11450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:31:21 (1788651081) === 00000100:00100000:2.0:1788651082.694840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651082.695458:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651082.695564:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356800 00000100:00100000:0.0:1788651082.695579:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356800 00000100:00100000:0.0:1788651082.695675:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1788651082.695689:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:9676:x1875536389356800:12345-192.168.203.21@tcp:700:mkdir.0 00000100:00100000:0.0:1788651082.695798:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:9676:x1875536389356800:12345-192.168.203.21@tcp:700:mkdir.0 Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651082.695806:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00080000:2.0:1788651082.698356:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651082.701814:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651082.707459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389356672 00000100:00100000:1.0:1788651082.707480:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389356672 00000100:00100000:1.0:1788651082.707591:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389357056 00000100:00100000:1.0:1788651082.707795:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389357056 00000100:00100000:1.0:1788651082.707842:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:1.0:1788651082.707855:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389356672:12345-192.168.203.21@tcp:41:mkdir.0 00000004:00000024:1.0:1788651082.707918:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788651082.708103:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389356672:12345-192.168.203.21@tcp:41:mkdir.0 Request processed in 249us (13277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651082.708141:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:1.0:1788651082.708163:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:1.0:1788651082.708170:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:9676:x1875536389357056:12345-192.168.203.21@tcp:36:mkdir.0 00010000:00010000:1.0:1788651082.708221:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651082.708539:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797720e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf75 expref: 6 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.708569:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759d00) 00010000:00010000:1.0:1788651082.708580:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651082.708998:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.709013:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.709024:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.709058:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.709065:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.709072:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651082.712067:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788651082.712085:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.712096:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.712104:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.717006:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9dc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651082.717014:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.717024:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.717043:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79b00) 00010000:00010000:1.0:1788651082.717046:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651082.717051:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.717058:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba88797732d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651082.717088:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043bad7eb reply state 00000000c57b3442 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651082.717099:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651082.720576:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9676:x1875536389357056:12345-192.168.203.21@tcp:36:mkdir.0 Request processed in 12397us (18767us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788651082.720599:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:1.0:1788651082.734749:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.734770:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.734779:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.734868:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651082.734874:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.734884:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.734904:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93be58f79d00) 00010000:00010000:1.0:1788651082.734907:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651082.734913:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.734920:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977334 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651082.737727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651082.738826:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389357184 00000100:00100000:2.0:1788651082.738843:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389357184 00000100:00100000:2.0:1788651082.738923:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:2.0:1788651082.738936:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:9677:x1875536389357184:12345-192.168.203.21@tcp:101:chmod.0 00010000:00010000:2.0:1788651082.738964:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651082.738996:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797733b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7bffa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.739083:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977342 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.739100:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.739179:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651082.739227:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651082.739233:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651082.739275:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.739308:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797733b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bffa expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.739330:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977342 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bffa expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.739726:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae100) 00010000:00010000:2.0:1788651082.739730:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651082.739734:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ba00, rc 0) 00000100:00100000:2.0:1788651082.739867:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9677:x1875536389357184:12345-192.168.203.21@tcp:101:chmod.0 Request processed in 933us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651082.739875:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1788651082.742855:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.743055:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389357440 00000100:00100000:3.0:1788651082.743067:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389357440 00000100:00100000:3.0:1788651082.743170:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1788651082.743182:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9677:x1875536389357440:12345-192.168.203.21@tcp:36:chmod.0 00010000:00010000:3.0:1788651082.743313:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651082.743350:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977342 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bffa expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.743374:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae100) 00010000:00010000:3.0:1788651082.743389:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651082.743425:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.743441:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.743452:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651082.744415:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c06ce037 reply state 00000000e23b00aa transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651082.744440:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788651082.744450:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788651082.744562:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:9677:x1875536389357440:12345-192.168.203.21@tcp:36:chmod.0 Request processed in 1381us (1719us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788651082.744570:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00010000:00010000:2.0:1788651082.747485:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.747508:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.747517:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.747543:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cb800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651082.747549:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.747559:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.747580:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759e00) 00010000:00010000:2.0:1788651082.747583:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788651082.747589:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.747596:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977349 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651082.773371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.773493:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389357568 00000100:00100000:3.0:1788651082.773505:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389357568 00000100:00100000:3.0:1788651082.773581:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:3.0:1788651082.773593:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9678:x1875536389357568:12345-192.168.203.21@tcp:101:chown.0 00010000:00010000:3.0:1788651082.773622:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651082.773653:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb600/0x84a2fba887977350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c001 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.773734:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977357 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.773749:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.773763:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651082.773804:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788651082.773807:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651082.773852:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.773880:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb600/0x84a2fba887977350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c001 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.773941:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977357 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c001 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.773951:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759800) 00010000:00010000:3.0:1788651082.773955:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651082.773969:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429cb800, rc 0) 00000100:00100000:3.0:1788651082.774044:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:9678:x1875536389357568:12345-192.168.203.21@tcp:101:chown.0 Request processed in 453us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651082.774053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:0.0:1788651082.777837:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.778169:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389357696 00000100:00100000:3.0:1788651082.778184:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389357696 00000100:00100000:3.0:1788651082.778279:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:3.0:1788651082.778292:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:9678:x1875536389357696:12345-192.168.203.21@tcp:101:chown.0 00010000:00010000:3.0:1788651082.778321:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651082.778349:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797735e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c008 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778440:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778457:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778472:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778491:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778516:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778523:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778644:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977373 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778653:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778660:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651082.778699:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788651082.778703:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651082.778724:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778738:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778745:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778752:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778759:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cdc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651082.778764:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778779:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778795:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759800) 00010000:00010000:3.0:1788651082.778798:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651082.778803:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778811:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cdc00/0x84a2fba887977365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778828:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778834:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778840:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778844:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cc000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651082.778847:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778852:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778858:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93be51759300) 00010000:00010000:3.0:1788651082.778861:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651082.778864:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778880:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be821cc000/0x84a2fba88797736c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778932:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca600/0x84a2fba88797735e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c008 expref: 10 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778950:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c008 expref: 9 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.778969:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be51759200) 00010000:00010000:3.0:1788651082.778972:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651082.778975:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c400, rc 0) 00000100:00100000:3.0:1788651082.779050:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:9678:x1875536389357696:12345-192.168.203.21@tcp:101:chown.0 Request processed in 760us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651082.779057:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1788651082.783380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651082.783662:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389357952 00000100:00100000:2.0:1788651082.783677:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389357952 00000100:00100000:2.0:1788651082.783764:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:2.0:1788651082.783778:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:9678:x1875536389357952:12345-192.168.203.21@tcp:36:chown.0 00010000:00010000:2.0:1788651082.783854:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651082.783887:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977373 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c008 expref: 9 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.783911:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be51759200) 00010000:00010000:2.0:1788651082.783924:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651082.783958:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.783974:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.784003:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651082.830176:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1788651082.830201:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788651082.830326:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccd2bf91 reply state 000000003d5e05e9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651082.830344:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788651082.830363:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788651082.830544:0:5843:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788651082.830574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9678:x1875536389357952:12345-192.168.203.21@tcp:36:chown.0 Request processed in 46790us (47196us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788651082.830586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00010000:00010000:1.0:1788651082.830672:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.830683:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.830690:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.830697:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651082.830702:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.830711:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.830755:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:1.0:1788651082.830758:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788651082.830765:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.830772:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797737a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651082.844903:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.845216:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389358080 00000100:00100000:3.0:1788651082.845230:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389358080 00000100:00100000:3.0:1788651082.845310:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:3.0:1788651082.845325:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:9679:x1875536389358080:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:3.0:1788651082.845357:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651082.845387:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977381 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c00f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788651082.847080:0:5871:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1499us 00010000:00010000:0.0:1788651082.861339:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861370:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861384:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861403:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861409:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861414:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861804:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be40031e00/0x84a2fba887977396 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861823:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be40031e00/0x84a2fba887977396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.861843:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be40031e00/0x84a2fba887977396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651082.862186:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788651082.862192:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651082.862241:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be40031e00/0x84a2fba887977396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862256:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862264:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862272:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862278:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40030000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651082.862284:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862292:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862307:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759800) 00010000:00010000:0.0:1788651082.862310:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651082.862315:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862323:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030000/0x84a2fba887977388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862347:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862354:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862360:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862366:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40030a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651082.862369:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862375:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862383:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93be44b46800) 00010000:00010000:0.0:1788651082.862386:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651082.862389:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862395:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be40030a00/0x84a2fba88797738f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862452:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c00f expref: 8 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862471:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be40031e00/0x84a2fba887977396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c00f expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.862491:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651082.862493:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788651082.862496:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be40031e00, rc 0) 00000100:00100000:0.0:1788651082.862597:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9679:x1875536389358080:12345-192.168.203.21@tcp:101:touch.500 Request processed in 17275us (17708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651082.862607:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1788651082.868227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.868323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389358336 00000100:00100000:3.0:1788651082.868336:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389358336 00000100:00100000:3.0:1788651082.868432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1788651082.868508:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9679:x1875536389358336:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:3.0:1788651082.868538:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651082.868570:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c600/0x84a2fba88797739d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c016 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.870398:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.870429:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.871542:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.871578:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.871589:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.871598:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788651082.878614:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788651082.879373:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879773b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879396:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879773b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879411:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879773b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879525:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879535:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879542:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879549:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651082.879554:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879563:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879577:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:3.0:1788651082.879580:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651082.879585:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879592:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651082.879607:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b18e6171 reply state 00000000af76b67b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651082.879616:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788651082.879721:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c600/0x84a2fba88797739d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c016 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879750:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879773b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c016 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.879759:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759300) 00010000:00010000:3.0:1788651082.879762:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651082.879764:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ca00, rc 0) 00000100:00100000:3.0:1788651082.880093:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:9679:x1875536389358336:12345-192.168.203.21@tcp:101:touch.500 Request processed in 11649us (11878us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788651082.880103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1788651082.886098:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651082.886232:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389358592 00000100:00100000:2.0:1788651082.886245:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389358592 00000100:00100000:2.0:1788651082.886325:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:2.0:1788651082.886338:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:9679:x1875536389358592:12345-192.168.203.21@tcp:36:touch.500 00010000:00010000:2.0:1788651082.886412:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651082.886456:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879773b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c016 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.886479:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759300) 00010000:00010000:2.0:1788651082.886491:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651082.886548:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.886564:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.886575:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886694:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886704:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886712:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886718:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651082.886723:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886732:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886743:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff93be51759700) 00010000:00010000:0.0:1788651082.886746:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651082.886751:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.886758:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879773ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651082.886771:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008992943b reply state 00000000fcc1aa56 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651082.886784:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651082.886988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:9679:x1875536389358592:12345-192.168.203.21@tcp:36:touch.500 Request processed in 650us (903us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788651082.886997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:1.0:1788651082.890663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:2.0:1788651082.890749:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.890765:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.890773:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.890780:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651082.890785:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.890796:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.891081:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651082.891086:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651082.891091:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651082.891099:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b000/0x84a2fba8879773c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651082.891306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389358720 00000100:00100000:3.0:1788651082.891319:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389358720 00000100:00100000:3.0:1788651082.891380:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:3.0:1788651082.891391:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:9679:x1875536389358720:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:3.0:1788651082.891420:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651082.891441:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c600/0x84a2fba8879773c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c01d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.891522:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c600/0x84a2fba8879773c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c01d expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.891538:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c600/0x84a2fba8879773c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c01d expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.891559:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759000) 00010000:00010000:3.0:1788651082.891562:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651082.891572:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c600, rc 0) 00000100:00100000:3.0:1788651082.891916:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:9679:x1875536389358720:12345-192.168.203.21@tcp:101:touch.500 Request processed in 524us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651082.891925:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:0.0:1788651082.895683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651082.895798:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389358848 00000100:00100000:1.0:1788651082.895881:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389358848 00000100:00100000:1.0:1788651082.896060:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651082.896071:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389358848:12345-192.168.203.21@tcp:8:touch.500 00010000:00080000:1.0:1788651082.896164:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1788651082.896207:0:6672:0:(genops.c:1385:class_connect()) connect: client f051ebe0-0677-425e-9b9b-54befcd9fd1c, cookie 0x84a2fba8879773ce 00002000:00100000:1.0:1788651082.896222:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f051ebe0-0677-425e-9b9b-54befcd9fd1c/ffff93bd4121c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788651082.896236:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788651082.896548:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788651082.896587:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93bd4121b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651082.896665:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2352:x1875536389358848:12345-192.168.203.21@tcp:8:touch.500 Request processed in 595us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651082.896674:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651082.899635:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.899732:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389358976 00000100:00100000:3.0:1788651082.899745:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389358976 00000100:00080000:2.0:1788651082.899882:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651082.899944:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1788651082.899957:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:0:x1875536389358976:12345-192.168.203.21@tcp:2:touch.500 00000001:00100000:0.0:1788651082.936840:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000001:00080000:0.0:1788651082.936862:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788651082.937049:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:0:x1875536389358976:12345-192.168.203.21@tcp:2:touch.500 Request processed in 37085us (37418us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788651082.937083:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1788651082.940326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.940428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389359232 00000100:00100000:3.0:1788651082.940471:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389359232 00000100:00100000:3.0:1788651082.940541:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1788651082.940553:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:9679:x1875536389359232:12345-192.168.203.21@tcp:35:touch.500 00000100:00100000:3.0:1788651082.941028:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:9679:x1875536389359232:12345-192.168.203.21@tcp:35:touch.500 Request processed in 476us (715us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788651082.941038:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:2.0:1788651082.954314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651082.954408:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389359360 00000100:00100000:1.0:1788651082.954498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389359360 00000100:00100000:1.0:1788651082.954599:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1788651082.954610:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:9680:x1875536389359360:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:1.0:1788651082.954637:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651082.954658:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879773d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c024 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.954728:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9da00/0x84a2fba8879773dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.954741:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9da00/0x84a2fba8879773dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.954753:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9da00/0x84a2fba8879773dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651082.954790:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788651082.954793:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651082.954828:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9da00/0x84a2fba8879773dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.954850:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879773d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c024 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.954866:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9da00/0x84a2fba8879773dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c024 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651082.954892:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651082.954894:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651082.954898:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9da00, rc 0) 00000100:00100000:1.0:1788651082.954987:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:9680:x1875536389359360:12345-192.168.203.21@tcp:101:rm.0 Request processed in 379us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651082.954995:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1788651082.958036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651082.958163:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389359616 00000100:00100000:0.0:1788651082.958176:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389359616 00000100:00100000:3.0:1788651082.958372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:3.0:1788651082.958388:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:9680:x1875536389359616:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:3.0:1788651082.958417:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651082.958442:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c02b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651082.958568:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788651082.958788:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c02b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.959392:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759800) 00010000:00010000:3.0:1788651082.959409:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651082.959420:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba8879773e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c02b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651082.959440:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56cc00, rc 0) 00000100:00100000:3.0:1788651082.959542:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:9680:x1875536389359616:12345-192.168.203.21@tcp:101:rm.0 Request processed in 1158us (1519us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788651082.959551:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:2.0:1788651082.963397:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.963503:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389359744 00000100:00100000:3.0:1788651082.963515:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389359744 00000100:00100000:3.0:1788651082.963656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1788651082.963671:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:9680:x1875536389359744:12345-192.168.203.21@tcp:37:rm.0 00000100:00100000:0.0:1788651082.969426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:9680:x1875536389359744:12345-192.168.203.21@tcp:37:rm.0 Request processed in 5742us (6029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651082.969458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:0.0:1788651082.973378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651082.973468:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389360000 00000100:00100000:3.0:1788651082.973486:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389360000 00000100:00100000:3.0:1788651082.973571:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1788651082.973584:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:9680:x1875536389360000:12345-192.168.203.21@tcp:35:rm.0 00000100:00100000:3.0:1788651082.973942:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:9680:x1875536389360000:12345-192.168.203.21@tcp:35:rm.0 Request processed in 358us (576us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788651082.973951:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1788651082.977702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651082.977821:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389360256 00000100:00100000:0.0:1788651082.977834:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389360256 00000100:00100000:0.0:1788651082.977911:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:0.0:1788651082.977924:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:9680:x1875536389360256:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:0.0:1788651082.977972:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651082.977999:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879773f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c032 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.978192:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879773f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.978210:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879773f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.978224:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879773f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651082.978238:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788651082.978411:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879773f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c032 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.978429:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879773f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c032 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.978437:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651082.978440:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651082.978443:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860e00, rc 0) 00000100:00100000:0.0:1788651082.978519:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389360256:12345-192.168.203.21@tcp:101:rm.0 Request processed in 597us (830us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788651082.978526:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:2.0:1788651082.981261:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651082.981665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389360384 00000100:00100000:0.0:1788651082.981678:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389360384 00000100:00100000:0.0:1788651082.981816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:0.0:1788651082.981830:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389360384:12345-192.168.203.21@tcp:41:rm.0 00000004:00000024:0.0:1788651082.981932:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788651082.982032:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389360384:12345-192.168.203.21@tcp:41:rm.0 Request processed in 204us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651082.982040:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1788651082.987392:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651082.987789:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389360512 00000100:00100000:0.0:1788651082.987803:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389360512 00000100:00100000:0.0:1788651082.987884:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1788651082.987896:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389360512:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:0.0:1788651082.987924:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651082.987951:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c039 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988065:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988083:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988098:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988531:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988542:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988551:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988684:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988693:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988701:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651082.988736:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788651082.988741:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651082.988765:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988790:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988799:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988806:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988813:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988820:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651082.988825:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988833:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988847:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651082.988850:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651082.988855:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988862:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba88797740d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988876:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988882:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988894:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988899:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651082.988902:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988909:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988916:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff93be44b46800) 00010000:00010000:0.0:1788651082.988919:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651082.988921:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988927:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988964:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c039 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988978:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c039 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651082.988986:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759000) 00010000:00010000:0.0:1788651082.988988:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651082.988991:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861400, rc 0) 00000100:00100000:0.0:1788651082.989091:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:9680:x1875536389360512:12345-192.168.203.21@tcp:101:rm.0 Request processed in 1196us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651082.989171:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1788651082.999871:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651083.000254:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389360768 00000100:00100000:3.0:1788651083.000268:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389360768 00000100:00100000:3.0:1788651083.000393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:3.0:1788651083.000406:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:9680:x1875536389360768:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:3.0:1788651083.000494:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788651083.000531:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797741b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c039 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000583:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c600/0x84a2fba8879773c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c01d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000597:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759000) 00010000:00010000:3.0:1788651083.000615:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9da00/0x84a2fba8879773dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c024 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000624:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:3.0:1788651083.000628:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651083.000654:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000669:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000679:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000695:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000712:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000720:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000879:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000900:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.000909:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651083.001896:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788651083.001913:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287061805173ns, next at 288061801799ns, rc = 0 00010000:00010000:3.0:1788651083.001988:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002004:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002014:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002024:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002031:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002037:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002066:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651083.002093:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002099:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002169:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002177:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651083.002183:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002191:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002205:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759300) 00010000:00010000:3.0:1788651083.002207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788651083.002213:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002220:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56de00/0x84a2fba887977430 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002240:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002245:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002251:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002257:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651083.002259:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002274:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:3.0:1788651083.002284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651083.002287:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651083.002292:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977422 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651083.002301:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008e08a54 reply state 000000005f50efe0 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651083.002311:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651083.002426:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389360768:12345-192.168.203.21@tcp:36:rm.0 Request processed in 2018us (2566us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788651083.002436:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00010000:00010000:2.0:1788651083.002608:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651083.002617:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651083.002624:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651083.002628:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651083.002635:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651083.002644:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93be51759300) 00010000:00010000:2.0:1788651083.002647:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788651083.002650:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651083.002656:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977437 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651083.002674:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651083.002676:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651083.002678:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651083.009509:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651083.009535:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651083.009545:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651083.009551:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651083.009557:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651083.009567:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651083.009589:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff93be51759f00) 00010000:00010000:0.0:1788651083.009593:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651083.009599:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651083.009605:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977429 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651083.010040:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651083.010209:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361024 00000100:00100000:3.0:1788651083.010223:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361024 00000100:00100000:0.0:1788651083.010330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1788651083.010344:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:9680:x1875536389361024:12345-192.168.203.21@tcp:35:rm.0 00000100:00100000:0.0:1788651083.010655:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389361024:12345-192.168.203.21@tcp:35:rm.0 Request processed in 313us (620us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788651083.010675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:2.0:1788651083.025908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651083.026091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361280 00000100:00100000:1.0:1788651083.026104:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361280 00000100:00100000:1.0:1788651083.026331:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:1.0:1788651083.026353:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:9680:x1875536389361280:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:1.0:1788651083.026434:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788651083.026469:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879773f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c032 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026497:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be40031e00/0x84a2fba887977396 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c00f expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026527:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651083.026547:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb800/0x84a2fba887977357 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c001 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026558:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759800) 00010000:00010000:1.0:1788651083.026566:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651083.026597:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026640:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026655:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026662:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.026669:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.027001:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.027011:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.027019:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651083.028437:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788651083.028464:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028473:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028479:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028491:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651083.028497:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028516:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028533:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93be58f79b00) 00010000:00010000:1.0:1788651083.028535:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788651083.028540:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028545:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797744c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028570:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028574:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028578:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028582:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651083.028583:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028586:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028599:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79d00) 00010000:00010000:1.0:1788651083.028600:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651083.028602:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.028606:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797743e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651083.028614:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029c316de reply state 00000000f9cbc4b0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651083.028622:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651083.028770:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:9680:x1875536389361280:12345-192.168.203.21@tcp:36:rm.0 Request processed in 2423us (2870us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788651083.028780:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00010000:00010000:1.0:1788651083.032895:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.032919:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.032929:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.032936:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9dc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651083.032942:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.032955:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.033001:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93be58f79700) 00010000:00010000:1.0:1788651083.033005:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651083.033012:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.033020:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9dc00/0x84a2fba887977445 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651083.077568:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651083.652452:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408265728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651083.652551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651083.652742:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265728 00000100:00100000:0.0:1788651083.652753:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265728 00000100:00100000:0.0:1788651083.652822:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788651083.652832:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408265728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651083.652876:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651083.652930:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408265728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651083.652937:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788651083.652960:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788651083.654265:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d402300 x1875536408265728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651083.654293:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408265728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651083.739682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651083.742396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651083.742684:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651083.742726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651083.742743:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361408 00000100:00100000:3.0:1788651083.742749:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361664 00000100:00100000:3.0:1788651083.742755:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361664 00000100:00100000:1.0:1788651083.742755:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361408 00000100:00100000:1.0:1788651083.742815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 240 00000100:00100000:3.0:1788651083.742823:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:1.0:1788651083.742827:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389361408:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651083.742830:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389361664:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651083.742918:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389361408:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 93us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651083.742926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 240 00000100:00100000:0.0:1788651083.743085:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361536 00000100:00100000:0.0:1788651083.743091:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361536 00000100:00100000:3.0:1788651083.743100:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389361664:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 270us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651083.743155:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:0.0:1788651083.743155:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361792 00000100:00100000:0.0:1788651083.743158:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361792 00000100:00100000:3.0:1788651083.743181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:0.0:1788651083.743187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:3.0:1788651083.743188:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:2356:x1875536389361536:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651083.743193:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389361792:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651083.743222:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:2356:x1875536389361536:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651083.743229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:0.0:1788651083.743230:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389361792:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651083.743236:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00080000:0.0:1788651083.743254:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651084.101145:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651085.125525:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651086.149601:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651086.724571:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bfd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408265856:0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.724821:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651086.724835:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bfd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408265984:0@lo:400:kworker.0 00000100:00100000:0.0:1788651086.724946:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651086.725052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651086.725141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265984 00000100:00100000:1.0:1788651086.725149:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265984 00000100:00100000:2.0:1788651086.725171:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bfd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408266112:0@lo:400:kworker.0 00000100:00100000:1.0:1788651086.725196:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788651086.725206:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651086.725206:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651086.725262:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408265984:12345-0@lo:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651086.725269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788651086.725280:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bfd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408265984:0@lo:400:kworker.0 00000100:00100000:1.0:1788651086.725283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266112 00000100:00100000:1.0:1788651086.725285:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266112 00000100:00100000:2.0:1788651086.725311:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408266240:0@lo:400:kworker.0 00000100:00100000:1.0:1788651086.725320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788651086.725326:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408266112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.725336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651086.725356:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408266112:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651086.725362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788651086.725373:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bfd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408266112:0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.725397:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788651086.725402:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651086.725403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408266368:0@lo:400:kworker.0 00000100:00100000:1.0:1788651086.725416:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266240 00000100:00100000:1.0:1788651086.725420:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266240 00000100:00100000:2.0:1788651086.725425:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651086.725449:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266368 00000100:00100000:1.0:1788651086.725449:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788651086.725452:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266368 00000100:00100000:1.0:1788651086.725455:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408266240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.725475:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788651086.725487:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408266368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651086.725487:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408266240:12345-0@lo:400:kworker.0 Request processed in 32us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651086.725493:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788651086.725509:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651086.725511:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651086.725514:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408266368:12345-0@lo:400:kworker.0 Request processed in 34us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651086.725527:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788651086.725555:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408266368:0@lo:400:kworker.0 00010000:00080000:2.0:1788651086.725573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7586e680 x1875536408266240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651086.725583:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408266240:0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.725626:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651086.725632:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408266496:0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.725668:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651086.725698:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266496 00000100:00100000:2.0:1788651086.725701:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266496 00000100:00100000:2.0:1788651086.725728:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788651086.725734:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408266496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.725768:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408266496:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651086.725774:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788651086.725789:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788651086.725805:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7586e680 x1875536408266496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651086.725814:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408266496:0@lo:400:kworker.0 00000100:00100000:3.0:1788651086.726419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408265856 00000100:00100000:3.0:1788651086.726425:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408265856 00000100:00100000:2.0:1788651086.726529:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788651086.726538:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408265856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651086.726578:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408265856:12345-0@lo:400:kworker.0 Request processed in 42us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651086.726584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788651086.726804:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bfd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408265856:0@lo:400:kworker.0 00000001:02000400:3.0:1788651086.897281:0:11600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788651087.172300:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788651087.236289:0:8015:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291296179015ns, next at 292296176487ns, rc = 0 00000100:00100000:1.0:1788651087.236454:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651087.236476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408266624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651087.236541:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651087.236723:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266624 00000100:00100000:3.0:1788651087.236730:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266624 00000100:00100000:3.0:1788651087.236789:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788651087.236800:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408266624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651087.236845:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651087.236898:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408266624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651087.236906:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788651087.236995:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d401180 x1875536408266624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651087.237014:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408266624:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788651087.770043:0:11648:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb734dbf0 20000000:00000080:3.0:1788651087.770062:0:11648:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93be75564000 uarg=0000000000000000 20000000:01000000:3.0:1788651087.770097:0:11648:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788651087.770142:0:11648:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788651087.770147:0:11648:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788651087.775831:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788651087.776027:0:11648:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788651087.787615:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788651087.787678:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788651087.787747:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788651087.787764:0:11648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788651087.787782:0:11648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787802:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787818:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787826:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977303 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787832:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887977311 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787838:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797731f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787845:0:11648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787894:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797731f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.787918:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797731f expref: 18 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651087.787932:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408266752:0@lo:104: 00000100:00100000:3.0:1788651087.787997:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651087.788072:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977311 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.788081:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977311 expref: 18 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651087.788091:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408266880:0@lo:104: 00000100:00100000:3.0:1788651087.788153:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651087.788181:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266752 00010000:00010000:3.0:1788651087.788185:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887977303 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651087.788189:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266752 00010000:00010000:3.0:1788651087.788192:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887977303 expref: 18 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651087.788200:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408267008:0@lo:104: 00000100:00100000:3.0:1788651087.788222:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651087.788237:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788651087.788239:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651087.788246:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408266880 00010000:00010000:3.0:1788651087.788248:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 12 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651087.788249:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408266880 00000100:00100000:3.0:1788651087.788257:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408267136:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651087.788259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408267008 00000100:00100000:0.0:1788651087.788261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408267008 00000100:00100000:0.0:1788651087.788272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651087.788279:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+5:11648:x1875536408266752:12345-0@lo:104: 00010000:00010000:0.0:1788651087.788290:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.788305:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651087.788312:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651087.788320:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408267264:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651087.788336:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788651087.788342:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+5:11648:x1875536408266752:12345-0@lo:104: Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651087.788348:0:11648:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be6582cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651087.788348:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651087.788363:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651087.788365:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408266752:0@lo:104: 00000100:00100000:0.0:1788651087.788368:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+4:11648:x1875536408266880:12345-0@lo:104: 00010000:00010000:0.0:1788651087.788376:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788416:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788651087.788421:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+4:11648:x1875536408266880:12345-0@lo:104: Request processed in 54us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651087.788427:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651087.788437:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788651087.788443:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11648:x1875536408267008:12345-0@lo:104: 00010000:00010000:0.0:1788651087.788450:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788493:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788651087.788504:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+3:11648:x1875536408267008:12345-0@lo:104: Request processed in 61us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651087.788510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788651087.788543:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788651087.788548:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788556:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788651087.788560:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788568:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651087.788574:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651087.788579:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651087.788606:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788613:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651087.788629:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788636:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be4618ac00/0x84a2fba88797731f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977326 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788645:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788651087.788648:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788664:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cb200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788651087.788667:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788673:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651087.788679:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651087.788684:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651087.788700:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788706:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651087.788713:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788719:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cb200/0x84a2fba887977311 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887977318 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788729:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651087.788731:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788736:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429caa00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788651087.788739:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788755:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.788758:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788651087.788763:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.788766:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788651087.788772:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788651087.788794:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408267392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651087.788800:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651087.788821:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788651087.788831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651087.788850:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651087.788859:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788651087.788859:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429caa00/0x84a2fba887977303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797730a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651087.788876:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408267520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651087.788880:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651087.788883:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651087.788886:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651087.788899:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651087.788905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651087.788911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408267648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651087.788945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408267392 00000100:00100000:0.0:1788651087.788946:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651087.788952:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408267392 00010000:00010000:1.0:1788651087.788974:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797731f expref: 19 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651087.788980:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408267520 00000100:00100000:0.0:1788651087.788986:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408267520 00000100:00100000:1.0:1788651087.789002:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408267648 00000100:00100000:1.0:1788651087.789007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408267648 00010000:00010000:0.0:1788651087.789008:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977311 expref: 20 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.789025:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977303 expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651087.789427:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408266880:0@lo:104: 00000100:00100000:3.0:1788651087.789435:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408267008:0@lo:104: 00000100:00100000:0.0:1788651087.790757:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788651087.790908:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788651087.790923:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+21:3306:x1875536408267520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651087.790940:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651087.790947:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977311 expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.790959:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977311 expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.790974:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a200/0x84a2fba887977318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977311 expref: 21 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.790988:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651087.791131:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3306:x1875536408267520:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651087.791138:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788651087.791155:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788651087.791161:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be460a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408267648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651087.791179:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651087.791185:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887977303 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.791192:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887977303 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.791202:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030800/0x84a2fba88797730a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887977303 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.791210:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651087.791246:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be460a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:3309:x1875536408267648:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651087.791252:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651087.791350:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408267520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651087.791413:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408267648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651087.791800:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:3306:x1875536408267392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651087.791814:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651087.791820:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797731f expref: 17 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.791830:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797731f expref: 17 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.791841:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cbc00/0x84a2fba887977326 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797731f expref: 17 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.791850:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651087.791878:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3306:x1875536408267392:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651087.791884:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651087.792179:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408267392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651087.794229:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408267136:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651087.794710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651087.794796:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651087.795027:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389361920 00000100:00100000:2.0:1788651087.795035:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389361920 00010000:00010000:2.0:1788651087.795072:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 13 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651087.795147:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362048 00000100:00100000:2.0:1788651087.795150:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362048 00010000:00010000:2.0:1788651087.795163:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 14 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651087.795182:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1788651087.795191:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+14:2356:x1875536389361920:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651087.795205:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651087.795211:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 14 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795224:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 14 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795246:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a800/0x84a2fba8879772fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bff3 expref: 14 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795261:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651087.795315:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389361920:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 125us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651087.795322:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1788651087.795352:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1788651087.795372:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:2356:x1875536389362048:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651087.795381:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651087.795386:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795396:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 12 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795407:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795416:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795442:0:11151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795450:0:11151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795457:0:11151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795464:0:11151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795470:0:11151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651087.795475:0:11151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795493:0:11151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795504:0:11151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651087.795514:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651087.795535:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:2356:x1875536389362048:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 177us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651087.795542:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00010000:00010000:0.0:1788651087.796884:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9ca00/0x84a2fba8879772f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfec expref: 11 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651087.796902:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875536408267264:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651087.797016:0:11648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.799061:0:11648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.799080:0:11648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651087.799088:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be6d56cc00/0x84a2fba887977453 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651088.196993:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788651088.306461:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:1.0:1788651088.306483:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788651088.306499:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788651088.306516:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788651088.306679:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651088.306699:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408267776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788651088.306764:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651088.306845:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408267776 00000100:00100000:2.0:1788651088.306852:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408267776 00000100:00100000:2.0:1788651088.307083:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651088.307103:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408267776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788651088.307228:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788651088.307263:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ca64b, atime: 0x6a9ca64b, ctime: 0x6a9ca64b, blocks: 0x1 00010000:00010000:2.0:1788651088.307270:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.307285:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=292s v=(0 0) 00010000:00010000:2.0:1788651088.307289:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651088.307295:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.307332:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.307343:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.307351:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.307369:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788651088.307901:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408267776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 807us (1133us total) trans 4294967300 rc 0/0 00000100:00080000:3.0:1788651088.308462:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651088.308494:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788651088.308521:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651088.308529:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.308540:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651088.308544:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.308555:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.308572:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.308589:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c84911/0x84a2fba88797745a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651088.308607:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651088.308609:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651088.308610:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788651088.308643:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be7586e680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788651088.308648:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408267776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788651088.772400:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408267904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651088.772485:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651088.773139:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408267904 00000100:00100000:1.0:1788651088.773148:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408267904 00000100:00100000:1.0:1788651088.773220:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788651088.773230:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408267904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651088.773264:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788651088.773609:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651088.778474:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408267904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5236us (5979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651088.778488:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788651088.778758:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be75f80 x1875536408267904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651088.778787:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408267904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651088.861135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651088.861177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651088.861209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651088.861242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651088.861291:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362432 00000100:00100000:2.0:1788651088.861301:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362432 00000100:00100000:2.0:1788651088.861361:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:2.0:1788651088.861371:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389362432:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651088.861438:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389362432:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651088.861446:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00080000:2.0:1788651088.861485:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651088.861541:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362304 00000100:00100000:3.0:1788651088.861546:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362304 00000100:00100000:3.0:1788651088.861590:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:3.0:1788651088.861598:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389362304:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651088.861630:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389362304:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651088.861636:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00080000:2.0:1788651088.861946:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651088.862131:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362560 00000100:00100000:2.0:1788651088.862137:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362560 00000100:00100000:2.0:1788651088.862188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:2.0:1788651088.862195:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389362560:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651088.862234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389362560:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 40us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651088.862241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:1.0:1788651088.862538:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362176 00000100:00100000:1.0:1788651088.862543:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362176 00000100:00100000:1.0:1788651088.862581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 242 00000100:00100000:1.0:1788651088.862589:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:2356:x1875536389362176:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651088.862631:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:2356:x1875536389362176:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 43us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651088.862637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 242 00000100:00080000:0.0:1788651088.863048:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788651089.220280:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651089.568256:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651089.568357:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362688 00000100:00100000:3.0:1788651089.568366:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362688 00000100:00100000:3.0:1788651089.568476:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 243 00000100:00100000:3.0:1788651089.568488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:5593:x1875536389362688:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651089.568508:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651089.568531:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56c600/0x84a2fba887977461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c040 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.568558:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56c600/0x84a2fba887977461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c040 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.569347:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56c600/0x84a2fba887977461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c040 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.569358:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c600, rc 0) 00000100:00100000:3.0:1788651089.569431:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389362688:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 945us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.569438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 243 00000100:00100000:3.0:1788651089.576282:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651089.577529:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362816 00000100:00100000:2.0:1788651089.577541:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362816 00000100:00100000:2.0:1788651089.577606:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 244 00000100:00100000:2.0:1788651089.577618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389362816:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651089.578418:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389362816:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 798us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.578429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 244 00000100:00100000:2.0:1788651089.584313:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651089.584883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389362944 00000100:00100000:3.0:1788651089.584893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389362944 00000100:00100000:3.0:1788651089.584982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 245 00000100:00100000:3.0:1788651089.584992:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389362944:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.585251:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389362944:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 260us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.585259:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 245 00000100:00100000:0.0:1788651089.592533:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651089.592694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363072 00000100:00100000:2.0:1788651089.592703:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363072 00000100:00100000:2.0:1788651089.592760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 246 00000100:00100000:2.0:1788651089.592783:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:9950:x1875536389363072:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651089.593538:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:9950:x1875536389363072:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 263us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.593551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 246 00000100:00100000:0.0:1788651089.597390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651089.597487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363200 00000100:00100000:3.0:1788651089.597578:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363200 00000100:00100000:3.0:1788651089.597630:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 247 00000100:00100000:3.0:1788651089.597641:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:9950:x1875536389363200:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651089.599297:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:9950:x1875536389363200:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 1649us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.599310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 247 00000100:00100000:0.0:1788651089.606399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651089.606909:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363328 00000100:00100000:2.0:1788651089.606918:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363328 00000100:00100000:2.0:1788651089.606970:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 248 00000100:00100000:2.0:1788651089.606980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:5593:x1875536389363328:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651089.606994:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651089.607029:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a600/0x84a2fba887977468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c047 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.607057:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a600/0x84a2fba887977468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c047 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.607068:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a600/0x84a2fba887977468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c047 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.607078:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a600, rc 0) 00000100:00100000:2.0:1788651089.608245:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389363328:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 1259us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.608256:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 248 00000100:00100000:0.0:1788651089.618825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651089.619172:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363456 00000100:00100000:3.0:1788651089.619182:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363456 00000100:00100000:3.0:1788651089.619235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 249 00000100:00100000:3.0:1788651089.619255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389363456:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.619530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389363456:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 276us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.619538:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 249 00000100:00100000:0.0:1788651089.625361:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651089.625451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363584 00000100:00100000:2.0:1788651089.625461:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363584 00000100:00100000:2.0:1788651089.625513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 250 00000100:00100000:2.0:1788651089.625523:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389363584:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651089.625742:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:5593:x1875536389363584:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 219us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.625750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 250 00000100:00100000:2.0:1788651089.631675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651089.637716:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363712 00000100:00100000:1.0:1788651089.637730:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363712 00000100:00100000:1.0:1788651089.637800:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 251 00000100:00100000:1.0:1788651089.637810:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:9953:x1875536389363712:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651089.638097:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:9953:x1875536389363712:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 276us (6418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651089.638259:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 251 00000100:00100000:0.0:1788651089.645643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651089.645900:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363840 00000100:00100000:3.0:1788651089.645913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363840 00000100:00100000:3.0:1788651089.646047:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 252 00000100:00100000:3.0:1788651089.646060:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:9953:x1875536389363840:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651089.647097:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:9953:x1875536389363840:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 1025us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.647130:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 252 10000000:01000000:1.0:1788651089.796241:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651089.796253:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93bd412bd800 from 7 10000000:01000000:1.0:1788651089.796355:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651089.796431:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651089.796445:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651089.796459:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651089.796495:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651089.796580:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651089.796688:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268032 00000100:00100000:2.0:1788651089.796699:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268032 00000100:00100000:1.0:1788651089.796773:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5957bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651089.796890:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788651089.796908:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:5838:x1875536408268032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651089.796943:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651089.796960:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a800/0x84a2fba887977476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797746f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.797008:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a800/0x84a2fba887977476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797746f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.797021:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a800/0x84a2fba887977476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797746f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.797033:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a800, rc 0) 00000100:00100000:2.0:1788651089.797142:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408268032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.797150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788651089.797253:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651089.797274:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651089.797284:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651089.797353:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.797380:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651089.797402:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651089.797509:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268160 00000100:00100000:2.0:1788651089.797526:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268160 00000100:00100000:2.0:1788651089.797591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788651089.797601:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408268160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651089.797902:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408268160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.797910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788651089.798033:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.798076:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.798182:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651089.798217:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651089.798505:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268288 00000100:00100000:2.0:1788651089.798512:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268288 00000100:00100000:2.0:1788651089.798708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788651089.798719:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408268288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651089.799445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408268288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 726us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.799469:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788651089.799485:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651089.800294:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11663:1875536408268416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651089.800336:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651089.800404:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651089.800441:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268416 00000100:00100000:1.0:1788651089.800447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268416 00000100:00100000:1.0:1788651089.800494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788651089.800503:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:11663:x1875536408268416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651089.800847:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11663:1875536408268416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651089.800885:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651089.800903:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651089.800905:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788651089.800913:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93bd412bd800 00000020:00000080:2.0:1788651089.800916:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651089.800963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:11663:x1875536408268416:12345-0@lo:502:llog_process_th.0 Request processed in 460us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651089.800981:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788651089.801010:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11663:1875536408268544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651089.801046:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651089.801074:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb076c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651089.801152:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268544 00000100:00100000:0.0:1788651089.801156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268544 00000100:00100000:0.0:1788651089.801192:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788651089.801208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:11663:x1875536408268544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651089.801479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:11663:x1875536408268544:12345-0@lo:502:llog_process_th.0 Request processed in 279us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651089.801487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788651089.804250:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11663:1875536408268544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651089.804311:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651089.804321:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651089.804323:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788651089.804329:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788651089.804538:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788651089.804574:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651089.804589:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651089.804603:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651089.804615:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651089.804618:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7bfe0800 from 7 10000000:01000000:1.0:1788651089.804622:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651089.804664:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651089.804674:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651089.804684:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651089.804711:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651089.804791:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651089.804847:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5957b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651089.804914:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268672 00000100:00100000:2.0:1788651089.804922:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268672 00000100:00100000:2.0:1788651089.805012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788651089.805023:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+17:5838:x1875536408268672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651089.805039:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651089.805054:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618b000/0x84a2fba887977484 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797747d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.805104:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618b000/0x84a2fba887977484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797747d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.805139:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618b000/0x84a2fba887977484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797747d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.805150:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b000, rc 0) 00000100:00100000:2.0:1788651089.805200:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408268672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.805207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788651089.805314:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651089.805333:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651089.805345:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651089.805417:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.805466:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651089.805497:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651089.805516:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268800 00000100:00100000:2.0:1788651089.805522:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268800 00000100:00100000:2.0:1788651089.805556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788651089.805565:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408268800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651089.805885:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408268800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.805894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788651089.805967:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.806014:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.806072:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651089.806102:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788651089.806139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408268928 00000100:00100000:1.0:1788651089.806144:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408268928 00000100:00100000:1.0:1788651089.806179:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788651089.806186:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408268928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651089.806377:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408268928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651089.806392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788651089.806479:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408268928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651089.814423:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11665:1875536408269056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651089.814527:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651089.814591:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788651089.814717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269056 00000100:00100000:1.0:1788651089.814726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269056 00000100:00100000:1.0:1788651089.814790:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788651089.814803:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:11665:x1875536408269056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651089.815083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+18:11665:x1875536408269056:12345-0@lo:502:llog_process_th.0 Request processed in 282us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651089.815101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788651089.815376:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11665:1875536408269056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651089.815414:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651089.815425:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651089.815428:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788651089.815436:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93be7bfe0800 00000020:00000080:2.0:1788651089.815439:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788651089.815546:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11665:1875536408269184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651089.815590:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651089.815626:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651089.815803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269184 00000100:00100000:1.0:1788651089.815811:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269184 00000040:00080000:2.0:1788651089.816441:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788651089.816561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788651089.816574:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:11665:x1875536408269184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651089.816801:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+18:11665:x1875536408269184:12345-0@lo:502:llog_process_th.0 Request processed in 231us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651089.816808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788651089.816892:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11665:1875536408269184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651089.816928:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651089.816935:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651089.816937:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788651089.816941:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788651089.819352:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788651089.819394:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651089.819408:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.819422:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651089.819434:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651089.819437:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be4384a800 from 7 10000000:01000000:3.0:1788651089.819441:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651089.819489:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.819498:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.819510:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651089.819541:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408269312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.819627:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651089.819682:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116840 going to sleep for 11 seconds 00000100:00100000:2.0:1788651089.819759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269312 00000100:00100000:2.0:1788651089.819770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269312 00000100:00100000:2.0:1788651089.819828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788651089.819839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:5838:x1875536408269312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651089.819855:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651089.819871:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a200/0x84a2fba887977492 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797748b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.819899:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a200/0x84a2fba887977492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797748b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.819910:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a200/0x84a2fba887977492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797748b expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651089.819920:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a200, rc 0) 00000100:00100000:2.0:1788651089.819966:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408269312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651089.819973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788651089.820067:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408269312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651089.820093:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.820103:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651089.820196:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408269440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.820231:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651089.820246:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651089.820260:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269440 00000100:00100000:3.0:1788651089.820264:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269440 00000100:00100000:3.0:1788651089.820284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788651089.820290:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408269440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.820587:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408269440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.820594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788651089.820625:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408269440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.820655:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408269568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.820694:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651089.820707:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651089.820719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269568 00000100:00100000:3.0:1788651089.820722:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269568 00000100:00100000:3.0:1788651089.820738:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788651089.820751:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408269568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.820913:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:5838:x1875536408269568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.820919:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788651089.820957:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be0363c2-36c6-418a-b340-2685dfcc42ae:5838:1875536408269568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651089.821232:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11668:1875536408269696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651089.821267:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651089.821286:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269696 00000100:00100000:3.0:1788651089.821289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269696 00000100:00100000:3.0:1788651089.821306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788651089.821312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:11668:x1875536408269696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651089.821442:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:11668:x1875536408269696:12345-0@lo:502:llog_process_th.0 Request processed in 129us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.821448:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788651089.821474:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116540 going to sleep for 11 seconds 00000100:00100000:3.0:1788651089.821484:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11668:1875536408269696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651089.821506:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651089.821517:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651089.821519:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788651089.821529:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93be4384a800 00000020:00000080:3.0:1788651089.821532:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788651089.821604:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11668:1875536408269824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651089.821641:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651089.821660:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269824 00000100:00100000:3.0:1788651089.821664:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269824 00000100:00100000:3.0:1788651089.821687:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788651089.821693:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:11668:x1875536408269824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651089.821796:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:11668:x1875536408269824:12345-0@lo:502:llog_process_th.0 Request processed in 103us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651089.821803:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788651089.821831:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651089.821842:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be0363c2-36c6-418a-b340-2685dfcc42ae:11668:1875536408269824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651089.821860:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651089.821864:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651089.821866:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788651089.821870:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788651089.821921:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788651089.821940:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651089.821950:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651089.821960:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651090.244420:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651090.820967:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788651091.268501:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651091.844374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408270080:0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.844444:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651091.844504:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408270336:0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.844507:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408270592:0@lo:400:kworker.0 00000100:00100000:0.0:1788651091.844544:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408269952:0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.844555:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651091.844597:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651091.844603:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408270208:0@lo:400:kworker.0 00000100:00100000:2.0:1788651091.845240:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270080 00000100:00100000:2.0:1788651091.845252:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270080 00000100:00100000:2.0:1788651091.845323:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788651091.845352:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408270080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651091.848385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651091.848400:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651091.848450:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408270464:0@lo:400:kworker.0 00000100:00100000:0.0:1788651091.848490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651091.848530:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270592 00000100:00100000:3.0:1788651091.848549:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270592 00000100:00100000:0.0:1788651091.848567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270208 00000100:00100000:0.0:1788651091.848573:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270208 00000100:00100000:0.0:1788651091.848602:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270464 00000100:00100000:0.0:1788651091.848604:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270464 00000100:00100000:3.0:1788651091.848620:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788651091.848625:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788651091.848634:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408270592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651091.848636:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408270208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.848699:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408270592:12345-0@lo:400:kworker.0 Request processed in 69us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651091.848706:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408270208:12345-0@lo:400:kworker.0 Request processed in 71us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651091.848712:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788651091.848716:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788651091.848735:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788651091.848740:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408269952 00000100:00100000:0.0:1788651091.848742:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408270464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.848745:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408269952 00000100:00100000:3.0:1788651091.848773:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788651091.848781:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408269952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651091.848793:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408270464:12345-0@lo:400:kworker.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651091.848800:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788651091.848836:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408270464:0@lo:400:kworker.0 00000100:00080000:0.0:1788651091.848871:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651091.848875:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651091.849230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408269952:12345-0@lo:400:kworker.0 Request processed in 448us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651091.849238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788651091.849377:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408270208:0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.849389:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408270592:0@lo:400:kworker.0 00000100:00100000:1.0:1788651091.849568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651091.849686:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270336 00000100:00100000:3.0:1788651091.849693:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270336 00000100:00100000:3.0:1788651091.850005:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788651091.850013:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408270336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651091.850066:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408270336:12345-0@lo:400:kworker.0 Request processed in 55us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651091.850084:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788651091.850363:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408270080:12345-0@lo:400:kworker.0 Request processed in 5008us (5913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651091.850376:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788651091.850613:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408270080:0@lo:400:kworker.0 00000100:00080000:1.0:1788651091.850752:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788651091.850784:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7586f800 x1875536408270336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651091.850790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408269952:0@lo:400:kworker.0 00000100:00100000:1.0:1788651091.851002:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408270336:0@lo:400:kworker.0 00010000:00010000:0.0:1788651092.292257:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651092.356639:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651092.356663:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408270720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651092.356729:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651092.358237:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270720 00000100:00100000:0.0:1788651092.358249:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270720 00000100:00100000:0.0:1788651092.358322:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788651092.358333:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408270720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651092.358376:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651092.358468:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408270720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651092.358475:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788651092.358616:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408270720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788651093.316512:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788651093.416577:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1788651093.892743:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651093.892768:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408270848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651093.892837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651093.892979:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270848 00000100:00100000:3.0:1788651093.893000:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270848 00000100:00100000:3.0:1788651093.893086:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651093.893095:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408270848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651093.893146:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651093.893189:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408270848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651093.893197:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788651093.893591:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788651093.893623:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be77b80 x1875536408270848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651093.893642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408270848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651093.979774:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651093.979825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651093.980264:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364096 00000100:00100000:1.0:1788651093.980274:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364096 00000100:00100000:1.0:1788651093.980345:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:1.0:1788651093.980367:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389364096:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651093.980437:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389364096:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 84us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651093.980445:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00080000:0.0:1788651093.980702:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651093.983654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389363968 00000100:00100000:3.0:1788651093.983671:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389363968 00000100:00100000:3.0:1788651093.983734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 269 00000100:00100000:3.0:1788651093.983744:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389363968:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651093.987218:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389363968:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 3457us (7374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651093.987232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 269 00000100:00100000:0.0:1788651093.989567:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651093.989719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651093.989826:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364352 00000100:00100000:2.0:1788651093.989835:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364352 00000100:00100000:2.0:1788651093.989903:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:2.0:1788651093.989914:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389364352:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651093.989992:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389364352:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651093.990001:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:3.0:1788651093.991223:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364224 00000100:00100000:3.0:1788651093.991233:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364224 00000100:00100000:3.0:1788651093.991330:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:3.0:1788651093.991338:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389364224:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651093.991432:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389364224:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 94us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651093.991440:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00080000:0.0:1788651093.992083:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651093.992089:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788651094.340321:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651095.364296:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651096.388475:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651096.966995:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408271232:0@lo:400:kworker.0 00000100:00100000:2.0:1788651096.967017:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408271360:0@lo:400:kworker.0 00000100:00100000:2.0:1788651096.967097:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651096.967098:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408271104:0@lo:400:kworker.0 00000100:00100000:3.0:1788651096.967152:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651096.967185:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788651096.967186:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408271616:0@lo:400:kworker.0 00000100:00100000:2.0:1788651096.967197:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408270976:0@lo:400:kworker.0 00000100:00100000:3.0:1788651096.967216:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651096.967254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651096.967280:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651096.967281:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271360 00000100:00100000:2.0:1788651096.967289:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408271488:0@lo:400:kworker.0 00000100:00100000:3.0:1788651096.967293:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271360 00000100:00100000:1.0:1788651096.967314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271104 00000100:00100000:1.0:1788651096.967320:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271104 00000100:00100000:3.0:1788651096.967350:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271616 00000100:00100000:3.0:1788651096.967354:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271616 00000100:00100000:1.0:1788651096.967356:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271232 00000100:00100000:1.0:1788651096.967361:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271232 00000100:00100000:3.0:1788651096.967388:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788651096.967394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788651096.967403:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408271360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651096.967407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408271104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651096.967429:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651096.967458:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408271360:12345-0@lo:400:kworker.0 Request processed in 57us (362us total) trans 0 rc 0/0 00010000:00080000:2.0:1788651096.967466:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe94700 x1875536408271360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651096.967468:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788651096.967484:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408271360:0@lo:400:kworker.0 00000100:00100000:3.0:1788651096.967488:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651096.967498:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408271616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651096.967526:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408271104:12345-0@lo:400:kworker.0 Request processed in 122us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651096.967536:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408271616:12345-0@lo:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651096.967536:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788651096.967546:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788651096.967556:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271488 00000100:00100000:1.0:1788651096.967560:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271488 00000100:00080000:3.0:1788651096.967566:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651096.967572:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651096.967575:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651096.967584:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788651096.967592:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408271232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651096.967621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788651096.967624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408270976 00000100:00100000:3.0:1788651096.967629:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408270976 00000100:00100000:0.0:1788651096.967634:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408271488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651096.967653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788651096.967660:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408270976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651096.967676:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408271488:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651096.967683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788651096.967699:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408270976:12345-0@lo:400:kworker.0 Request processed in 38us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651096.967709:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788651096.967710:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408271232:12345-0@lo:400:kworker.0 Request processed in 115us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651096.967725:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408271104:0@lo:400:kworker.0 00000100:00100000:1.0:1788651096.967728:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788651096.967736:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788651096.967741:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be7586e680, transno 4294967300 00000100:00100000:0.0:1788651096.967752:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408271616:0@lo:400:kworker.0 00000100:00100000:1.0:1788651096.967771:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408271232:0@lo:400:kworker.0 00000100:00100000:2.0:1788651096.967873:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788651096.967884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408271488:0@lo:400:kworker.0 00010000:00010000:2.0:1788651097.412244:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651097.476901:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651097.476924:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408271744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651097.477005:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651097.477126:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271744 00000100:00100000:3.0:1788651097.477135:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271744 00000100:00100000:3.0:1788651097.477191:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788651097.477211:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408271744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651097.477384:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651097.477444:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408271744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 234us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651097.477451:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788651097.477658:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408271744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788651098.437414:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651099.012629:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651099.012651:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651099.012714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651099.015676:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408271872 00000100:00100000:1.0:1788651099.015691:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408271872 00000100:00100000:1.0:1788651099.016016:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788651099.016037:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408271872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651099.016076:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651099.016184:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408271872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651099.016191:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788651099.017454:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be75880 x1875536408271872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651099.017479:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408271872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788651099.017731:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651099.100343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651099.100387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651099.100424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651099.100472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651099.100550:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364480 00000100:00100000:3.0:1788651099.100560:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364480 00000100:00100000:3.0:1788651099.100616:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 271 00000100:00100000:3.0:1788651099.100626:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389364480:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651099.100699:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389364480:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651099.100707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 271 00000100:00100000:3.0:1788651099.100742:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364736 00000100:00100000:3.0:1788651099.100746:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364736 00000100:00100000:3.0:1788651099.100784:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:3.0:1788651099.100791:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389364736:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651099.100839:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389364736:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651099.100846:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00080000:3.0:1788651099.100961:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651099.101082:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364608 00000100:00100000:2.0:1788651099.101086:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364608 00000100:00100000:2.0:1788651099.101152:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364864 00000100:00100000:2.0:1788651099.101155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364864 00000100:00100000:2.0:1788651099.101176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:2.0:1788651099.101228:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389364608:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651099.101268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389364608:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 86us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651099.102479:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:1.0:1788651099.102500:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389364864:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651099.102558:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389364864:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 67us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651099.102565:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00080000:1.0:1788651099.102672:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651099.105761:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 100 00010000:00010000:1.0:1788651099.460296:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651100.037406:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788651100.484660:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651101.508246:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651102.084412:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408272000:0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.084490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651102.084567:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408272256:0@lo:400:kworker.0 00000100:00100000:0.0:1788651102.084608:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651102.084613:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408272512:0@lo:400:kworker.0 00000100:00100000:0.0:1788651102.084635:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788651102.084643:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408272128:0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.084658:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651102.084677:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651102.084680:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651102.084688:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408272384:0@lo:400:kworker.0 00000100:00100000:0.0:1788651102.084704:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408272640:0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.084718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651102.084738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651102.084775:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272512 00000100:00100000:0.0:1788651102.084775:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272256 00000100:00100000:2.0:1788651102.084784:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272512 00000100:00100000:0.0:1788651102.084784:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272256 00000100:00100000:2.0:1788651102.084832:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272128 00000100:00100000:2.0:1788651102.084836:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272128 00000100:00100000:2.0:1788651102.084868:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651102.084875:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408272512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.084922:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408272512:12345-0@lo:400:kworker.0 Request processed in 47us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651102.084929:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651102.084945:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788651102.084951:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408272128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.084981:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408272128:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651102.084987:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788651102.085037:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408272512:0@lo:400:kworker.0 00000100:00100000:3.0:1788651102.085078:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272384 00000100:00100000:2.0:1788651102.085079:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272640 00000100:00100000:3.0:1788651102.085084:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272384 00000100:00100000:2.0:1788651102.085086:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272640 00000100:00100000:3.0:1788651102.085155:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788651102.085163:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651102.085335:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272000 00000100:00100000:1.0:1788651102.085339:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272000 00000100:00100000:0.0:1788651102.085372:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788651102.085377:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788651102.085383:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408272256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651102.085390:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408272000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651102.085427:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408272256:12345-0@lo:400:kworker.0 Request processed in 47us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651102.085435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788651102.085465:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788651102.085468:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408272128:0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.085476:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408272640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651102.085484:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408272256:0@lo:400:kworker.0 00000100:00100000:3.0:1788651102.085525:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408272384:12345-0@lo:400:kworker.0 Request processed in 363us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651102.085527:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408272640:12345-0@lo:400:kworker.0 Request processed in 52us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651102.085537:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408272640:0@lo:400:kworker.0 00000100:00100000:2.0:1788651102.085541:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651102.085551:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788651102.085571:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651102.085575:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651102.085578:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651102.085768:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d400700 x1875536408272384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651102.085771:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408272000:12345-0@lo:400:kworker.0 Request processed in 384us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651102.085788:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788651102.085792:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408272384:0@lo:400:kworker.0 00000100:00100000:3.0:1788651102.085923:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408272000:0@lo:400:kworker.0 00010000:00010000:1.0:1788651102.532319:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651102.596406:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651102.596441:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408272768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651102.596509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651102.596564:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272768 00000100:00100000:1.0:1788651102.596573:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272768 00000100:00100000:1.0:1788651102.596622:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788651102.596632:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408272768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651102.596669:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651102.596723:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408272768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651102.596731:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788651102.596759:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408272768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651103.556315:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651104.132521:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651104.132544:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408272896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651104.132611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651104.132733:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408272896 00000100:00100000:1.0:1788651104.132742:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408272896 00000100:00100000:1.0:1788651104.132823:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788651104.132833:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408272896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651104.132866:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651104.132921:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408272896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651104.132927:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788651104.133166:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788651104.133306:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7be77800 x1875536408272896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651104.133339:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408272896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651104.220853:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651104.220982:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389364992 00000100:00100000:3.0:1788651104.221001:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389364992 00000100:00100000:3.0:1788651104.221058:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 273 00000100:00100000:3.0:1788651104.221069:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389364992:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651104.221188:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389364992:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 120us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651104.221195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 273 00000100:00100000:1.0:1788651104.230685:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651104.230792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365120 00000100:00100000:0.0:1788651104.230806:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365120 00000100:00100000:0.0:1788651104.230903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:0.0:1788651104.230918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389365120:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651104.231014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389365120:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 101us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651104.231021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00080000:1.0:1788651104.231148:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651104.240159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651104.240281:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365248 00000100:00100000:3.0:1788651104.240293:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365248 00000100:00100000:3.0:1788651104.240376:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:3.0:1788651104.240387:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2352:x1875536389365248:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:3.0:1788651104.240425:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879773ce 00000100:00080000:3.0:1788651104.240437:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93bd4121b000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788651104.240440:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1788651104.240487:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788651104.240809:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651104.241336:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+2:2352:x1875536389365248:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 945us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651104.241346:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1788651104.241468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651104.242470:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365376 00000100:00100000:3.0:1788651104.245007:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365376 00000100:00100000:3.0:1788651104.245242:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:3.0:1788651104.245254:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389365376:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651104.245357:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389365376:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 105us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651104.245365:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00080000:1.0:1788651104.252021:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651104.580514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651105.604361:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651106.628407:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651107.206067:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408273024:0@lo:400:kworker.0 00000100:00100000:1.0:1788651107.206071:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788651107.206163:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408273408:0@lo:400:kworker.0 00000100:00100000:3.0:1788651107.206208:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408273152:0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.209243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651107.209319:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408273536:0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.209355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651107.209402:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273024 00000100:00100000:2.0:1788651107.209409:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273024 00000100:00100000:2.0:1788651107.209453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788651107.209462:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408273024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.209514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408273024:12345-0@lo:400:kworker.0 Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651107.209521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788651107.209566:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408273024:0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.209785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273536 00000100:00100000:2.0:1788651107.209790:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273536 00000100:00100000:2.0:1788651107.209826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788651107.209833:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408273536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.209883:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408273536:12345-0@lo:400:kworker.0 Request processed in 51us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651107.209890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788651107.209907:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651107.209942:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408273536:0@lo:400:kworker.0 00000100:00100000:0.0:1788651107.210949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651107.211026:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273408 00000100:00100000:2.0:1788651107.211032:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273408 00000100:00100000:2.0:1788651107.211080:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788651107.211088:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408273408:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788651107.211130:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651107.211168:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408273408:12345-0@lo:400:kworker.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651107.211188:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788651107.211195:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be6d400700 x1875536408273408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651107.211211:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408273408:0@lo:400:kworker.0 00000100:00100000:3.0:1788651107.211297:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651107.211328:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408273664:0@lo:400:kworker.0 00000100:00100000:3.0:1788651107.211351:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651107.211432:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273664 00000100:00100000:0.0:1788651107.211437:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273664 00000100:00100000:0.0:1788651107.211486:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788651107.211487:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273152 00000100:00100000:2.0:1788651107.211493:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273152 00000100:00100000:0.0:1788651107.211496:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408273664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.211527:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788651107.211537:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408273152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651107.211540:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408273664:12345-0@lo:400:kworker.0 Request processed in 45us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651107.211547:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788651107.211619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651107.211642:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408273664:0@lo:400:kworker.0 00000100:00100000:3.0:1788651107.211772:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408273152:0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.211773:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408273152:12345-0@lo:400:kworker.0 Request processed in 236us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651107.211785:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788651107.211824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651107.211914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273280 00000100:00100000:2.0:1788651107.211919:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273280 00000100:00080000:3.0:1788651107.211975:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651107.212038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788651107.212198:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408273280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651107.212284:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408273280:12345-0@lo:400:kworker.0 Request processed in 238us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651107.212292:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788651107.218790:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408273280:0@lo:400:kworker.0 00010000:00010000:1.0:1788651107.652849:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651107.716635:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408273792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651107.716729:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651107.716793:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273792 00000100:00100000:2.0:1788651107.716802:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273792 00000100:00100000:2.0:1788651107.716861:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788651107.716871:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408273792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651107.716908:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651107.720247:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408273792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3365us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651107.720262:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788651107.720382:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408273792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788651108.678050:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788651108.813168:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:1.0:1788651108.813181:0:7633:0:(genops.c:885:class_export_put()) final put ffff93bd4121c000/f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:1.0:1788651108.813213:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93bd4121c000/f051ebe0-0677-425e-9b9b-54befcd9fd1c for lustre-OST0001 00000020:00000080:1.0:1788651108.813267:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93bd4121b000 for lustre-OST0001 00000100:00100000:3.0:1788651109.254331:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651109.254360:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651109.254461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651109.254535:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408273920 00000100:00100000:3.0:1788651109.254544:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408273920 00000100:00100000:3.0:1788651109.254609:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788651109.254620:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408273920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651109.254663:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651109.254722:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408273920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651109.254729:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788651109.254760:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788651109.254996:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7fe97800 x1875536408273920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651109.255020:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651109.342704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651109.342751:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651109.342784:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651109.342819:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365632 00000100:00100000:2.0:1788651109.342832:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365632 00000100:00100000:3.0:1788651109.342845:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365504 00000100:00100000:3.0:1788651109.342853:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365504 00000100:00100000:2.0:1788651109.342916:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365760 00000100:00100000:2.0:1788651109.342920:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365760 00000100:00100000:3.0:1788651109.342925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 275 00000100:00100000:3.0:1788651109.342942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389365504:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651109.342961:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:2.0:1788651109.342973:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389365632:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651109.343042:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:3.0:1788651109.343046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389365504:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 107us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651109.343056:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389365760:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651109.343058:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 275 00000100:00080000:3.0:1788651109.343535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651109.348511:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389365632:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 5520us (5738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651109.348532:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:2.0:1788651109.362337:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389365760:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 19269us (19534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651109.362354:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 111 00010000:00010000:0.0:1788651109.700296:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788651110.278702:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788651110.725431:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788651111.537769:0:11834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:31:50 (1788651110) 00010000:00010000:3.0:1788651111.749915:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651112.324314:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651112.324538:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408274176:0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.324608:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651112.324685:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651112.324691:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408274304:0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.324715:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651112.324764:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274176 00000100:00100000:1.0:1788651112.324771:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274176 00000100:00100000:1.0:1788651112.324809:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274304 00000100:00100000:1.0:1788651112.324812:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274304 00000100:00100000:1.0:1788651112.324840:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788651112.324849:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408274176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.324915:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408274176:12345-0@lo:400:kworker.0 Request processed in 67us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651112.324923:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788651112.324962:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788651112.324969:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be758c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408274304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.324997:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be758c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408274304:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651112.325003:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788651112.325040:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408274304:0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.325052:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408274176:0@lo:400:kworker.0 00000100:00100000:0.0:1788651112.329290:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408274432:0@lo:400:kworker.0 00000100:00100000:0.0:1788651112.329373:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651112.329433:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408274048:0@lo:400:kworker.0 00000100:00100000:0.0:1788651112.329461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788651112.329540:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651112.329630:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274048 00000100:00100000:2.0:1788651112.329638:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274048 00000100:00100000:2.0:1788651112.329692:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788651112.329702:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408274048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651112.329759:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408274048:12345-0@lo:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651112.329766:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788651112.329819:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408274048:0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.330173:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274432 00000100:00100000:1.0:1788651112.330177:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274432 00000100:00100000:1.0:1788651112.330238:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788651112.330247:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408274432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651112.330290:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408274432:12345-0@lo:400:kworker.0 Request processed in 45us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651112.330297:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788651112.330408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788651112.330473:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7bad0700 x1875536408274432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651112.330485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408274432:0@lo:400:kworker.0 00000100:00100000:0.0:1788651112.330735:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408274688:0@lo:400:kworker.0 00000100:00100000:0.0:1788651112.330765:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651112.330815:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651112.330824:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408274560:0@lo:400:kworker.0 00000100:00100000:2.0:1788651112.330851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651112.330894:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274560 00000100:00100000:2.0:1788651112.330899:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274560 00000100:00100000:2.0:1788651112.330928:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788651112.330945:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408274560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651112.330980:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875536408274560:12345-0@lo:400:kworker.0 Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651112.330986:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788651112.331012:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875536408274560:0@lo:400:kworker.0 00000100:00100000:3.0:1788651112.331152:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274688 00000100:00100000:3.0:1788651112.331157:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274688 00000100:00100000:3.0:1788651112.331187:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788651112.331194:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408274688:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788651112.331361:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651112.331364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651112.331698:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408274688:12345-0@lo:400:kworker.0 Request processed in 503us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651112.331705:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788651112.333033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408274688:0@lo:400:kworker.0 00010000:00010000:0.0:1788651112.772720:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651112.837763:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651112.837832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651112.837978:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274816 00000100:00100000:3.0:1788651112.837986:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274816 00000100:00100000:3.0:1788651112.838039:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788651112.838058:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408274816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651112.838096:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651112.838174:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408274816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651112.838181:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788651112.838896:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651113.394351:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651113.394536:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389365888 00000100:00100000:2.0:1788651113.394553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389365888 00000100:00100000:2.0:1788651113.394660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:2.0:1788651113.394684:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:10222:x1875536389365888:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651113.394705:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651113.394728:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c04e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.394812:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879774a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.394828:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879774a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.394842:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879774a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651113.394885:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651113.394889:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:1.0:1788651113.394933:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788651113.394947:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879774a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.394975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c04e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.394993:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879774a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c04e expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.395001:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae000) 00010000:00010000:2.0:1788651113.395003:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651113.395007:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:2.0:1788651113.395094:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:10222:x1875536389365888:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 424us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651113.395102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:3.0:1788651113.403613:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651113.404184:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366016 00000100:00100000:2.0:1788651113.404203:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366016 00000100:00100000:2.0:1788651113.404311:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1788651113.404332:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:10223:x1875536389366016:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651113.404359:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651113.404388:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879774a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c055 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.404473:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.404489:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.404503:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.404519:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.404526:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.404533:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405012:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a000/0x84a2fba8879774bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405022:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a000/0x84a2fba8879774bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405030:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a000/0x84a2fba8879774bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651113.405071:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651113.405075:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651113.405095:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a000/0x84a2fba8879774bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405156:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405163:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405169:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405175:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651113.405180:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405188:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405203:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae000) 00010000:00010000:2.0:1788651113.405207:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651113.405211:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405217:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879774ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405230:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405247:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405253:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405259:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651113.405262:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405268:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405277:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93be449ae500) 00010000:00010000:2.0:1788651113.405280:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651113.405283:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405288:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879774b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405325:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879774a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c055 expref: 8 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405340:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a000/0x84a2fba8879774bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c055 expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.405347:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93be449ae600) 00010000:00010000:2.0:1788651113.405349:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651113.405359:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a000, rc 0) 00000100:00100000:2.0:1788651113.405435:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:10223:x1875536389366016:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1113us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651113.405443:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:0.0:1788651113.411887:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651113.412007:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366272 00000100:00100000:2.0:1788651113.412020:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366272 00000100:00100000:2.0:1788651113.412104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1788651113.412153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:10223:x1875536389366272:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651113.412180:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651113.412211:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba8879774c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c05c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.412338:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.412362:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.412379:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.412584:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.412613:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.412626:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.414423:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba8879774d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.414457:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba8879774d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.414467:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba8879774d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651113.414493:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788651113.414695:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.414704:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.414712:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.414718:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651113.414722:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416889:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416910:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93be449ae600) 00010000:00010000:2.0:1788651113.416913:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651113.416919:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416939:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879774ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416959:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416984:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416991:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.416997:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651113.417001:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.417008:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.417017:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93be449ae400) 00010000:00010000:2.0:1788651113.417019:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651113.417022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.417028:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879774d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.417660:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba8879774c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c05c expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.417679:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba8879774d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c05c expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651113.417687:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:2.0:1788651113.417689:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651113.417698:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b200, rc 0) 00000100:00100000:2.0:1788651113.417769:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:10223:x1875536389366272:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 5619us (5898us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788651113.420299:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:0.0:1788651113.422508:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651113.423227:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366400 00000100:00100000:1.0:1788651113.423249:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366400 00000100:00100000:1.0:1788651113.423330:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1788651113.423342:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:10223:x1875536389366400:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788651113.423629:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:10223:x1875536389366400:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 Request processed in 287us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651113.423638:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00010000:00010000:1.0:1788651113.796468:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788651113.939373:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000040:00080000:1.0:1788651114.375548:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788651114.377965:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408274944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651114.378040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651114.378139:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408274944 00000100:00100000:2.0:1788651114.378147:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408274944 00000100:00100000:2.0:1788651114.378445:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788651114.378457:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408274944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651114.378493:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651114.378539:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408274944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651114.378546:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788651114.378567:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788651114.378615:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be7586f480 x1875536408274944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651114.378634:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408274944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651114.472486:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651114.472535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651114.472558:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651114.472584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366784 00000100:00100000:3.0:1788651114.472593:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366784 00000100:00100000:3.0:1788651114.472650:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366656 00000100:00100000:3.0:1788651114.472653:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366656 00000100:00100000:3.0:1788651114.472675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1788651114.472685:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389366784:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651114.472823:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2355:x1875536389366784:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 139us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651114.472831:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1788651114.472849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:3.0:1788651114.472856:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389366656:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651114.473032:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389366656:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 175us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651114.473038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00080000:3.0:1788651114.473059:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651114.473447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366528 00000100:00100000:0.0:1788651114.473452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366528 00000100:00100000:0.0:1788651114.473594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 277 00000100:00100000:0.0:1788651114.473603:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389366528:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651114.473632:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389366528:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 30us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651114.473639:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 277 00010000:00010000:3.0:1788651114.822187:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651115.644482:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651115.644598:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389366912 00000100:00100000:3.0:1788651115.644609:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389366912 00000100:00100000:3.0:1788651115.644707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:3.0:1788651115.644718:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:10266:x1875536389366912:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651115.644737:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651115.644758:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879774e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c063 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.644820:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.644851:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.644865:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.644883:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.644890:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.644898:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645134:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645142:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645149:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645155:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651115.645159:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645166:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645178:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae000) 00010000:00010000:3.0:1788651115.645186:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651115.645192:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645199:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879774ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645211:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645217:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645223:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645228:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651115.645231:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645237:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93be51759700) 00010000:00010000:3.0:1788651115.645247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651115.645250:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645255:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879774f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645286:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879774e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c063 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645308:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae000) 00010000:00010000:3.0:1788651115.645310:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651115.645315:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879774e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c063 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.645324:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56da00, rc 0) 00000100:00100000:3.0:1788651115.645378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:10266:x1875536389366912:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 662us (916us total) trans 0 rc 301/301 00000100:00100000:3.0:1788651115.645385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00080000:0.0:1788651115.649695:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651115.655067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651115.655274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389367168 00000100:00100000:3.0:1788651115.655284:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389367168 00000100:00100000:3.0:1788651115.655339:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1788651115.655350:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:10266:x1875536389367168:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:3.0:1788651115.655427:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651115.655456:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879774a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c04e expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.655582:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae000) 00010000:00010000:3.0:1788651115.655595:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651115.655785:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.655800:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.655917:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.655943:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.655952:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.655959:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651115.658829:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788651115.659616:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.659626:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.659634:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.659640:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651115.659644:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.659652:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.659667:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be51759600) 00010000:00010000:3.0:1788651115.659670:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651115.659674:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.659691:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879774fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651115.659711:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c568282 reply state 000000000e9703e3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651115.659719:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651115.660647:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:10266:x1875536389367168:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 4481us (4771us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788651115.660661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00010000:00010000:1.0:1788651115.687303:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.687321:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.687329:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.687335:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651115.687340:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.687348:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.687365:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93be51759400) 00010000:00010000:1.0:1788651115.687369:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651115.687373:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.687379:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977502 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651115.772496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651115.772574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389367296 00000100:00100000:1.0:1788651115.772583:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389367296 00000100:00100000:1.0:1788651115.772643:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:1.0:1788651115.772653:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:10274:x1875536389367296:12345-192.168.203.21@tcp:101:lctl.0 00010000:00010000:1.0:1788651115.772675:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651115.772712:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c06a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.772769:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977510 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.772783:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.772794:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651115.772824:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788651115.772827:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651115.772860:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.772880:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c06a expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.772895:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977510 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c06a expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.772904:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:1.0:1788651115.772918:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651115.772922:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c000, rc 0) 00000100:00100000:1.0:1788651115.772975:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:10274:x1875536389367296:12345-192.168.203.21@tcp:101:lctl.0 Request processed in 324us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651115.772983:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:2.0:1788651115.813897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651115.814030:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389367424 00000100:00100000:0.0:1788651115.814039:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389367424 00000100:00100000:0.0:1788651115.814292:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:0.0:1788651115.814303:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:10280:x1875536389367424:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1788651115.814326:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651115.814344:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c071 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814398:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814413:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814424:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814437:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814444:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814450:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814526:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860200/0x84a2fba88797752c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814534:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860200/0x84a2fba88797752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814541:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860200/0x84a2fba88797752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651115.814677:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788651115.814685:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651115.814720:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860200/0x84a2fba88797752c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814731:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814738:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814745:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814751:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651115.814755:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814763:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814775:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:0.0:1788651115.814778:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651115.814782:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814789:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba88797751e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814799:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814806:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814822:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814827:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651115.814830:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814837:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814844:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93be44b46100) 00010000:00010000:0.0:1788651115.814846:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651115.814848:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814854:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977525 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814881:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c071 expref: 11 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814960:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860200/0x84a2fba88797752c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c071 expref: 10 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651115.814967:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:0.0:1788651115.814969:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788651115.814972:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860200, rc 0) 00000100:00100000:0.0:1788651115.815058:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:10280:x1875536389367424:12345-192.168.203.21@tcp:101:bash.0 Request processed in 757us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651115.815072:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:0.0:1788651115.821030:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651115.834855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389367680 00000100:00100000:2.0:1788651115.834867:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389367680 00000100:00100000:2.0:1788651115.834951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:2.0:1788651115.834963:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:10280:x1875536389367680:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651115.834981:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651115.835024:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977533 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c078 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.835335:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.835351:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.835363:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.835448:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.835456:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.835464:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651115.836677:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788651115.836967:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.836980:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.836989:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837024:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837042:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837049:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837055:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651115.837060:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837196:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837211:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:2.0:1788651115.837214:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651115.837219:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837270:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba88797753a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651115.837284:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014df13a4 reply state 00000000a847de9c transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651115.837294:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788651115.837501:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977533 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837520:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.837540:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:2.0:1788651115.837543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651115.837667:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:2.0:1788651115.837742:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10280:x1875536389367680:12345-192.168.203.21@tcp:101:bash.0 Request processed in 2781us (16719us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788651115.837751:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00010000:00010000:0.0:1788651115.845824:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651115.846382:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:1.0:1788651115.850669:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.850690:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.850711:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.850717:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651115.850721:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.850729:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.850744:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be449ae400) 00010000:00010000:1.0:1788651115.850747:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651115.850752:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.851442:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977541 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651115.851489:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389367808 00000100:00100000:1.0:1788651115.851500:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389367808 00000100:00100000:1.0:1788651115.851543:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651115.851550:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389367808:12345-192.168.203.21@tcp:8:bash.0 00010000:00080000:1.0:1788651115.851581:0:6672:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:1.0:1788651115.851611:0:6672:0:(genops.c:1385:class_connect()) connect: client f051ebe0-0677-425e-9b9b-54befcd9fd1c, cookie 0x84a2fba887977556 00002000:00100000:1.0:1788651115.851624:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f051ebe0-0677-425e-9b9b-54befcd9fd1c/ffff93be74ff3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788651115.851646:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788651115.851946:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788651115.851980:0:6672:0:(import.c:65:import_set_state_nolock()) ffff93be74ff7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651115.852058:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2352:x1875536389367808:12345-192.168.203.21@tcp:8:bash.0 Request processed in 506us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651115.852066:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:3.0:1788651115.856693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651115.857000:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389367936 00000100:00100000:2.0:1788651115.857010:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389367936 00000100:00100000:2.0:1788651115.857992:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1788651115.858005:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:0:x1875536389367936:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651115.858030:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651115.858051:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c07f expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651115.858073:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788651115.858131:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651115.858151:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1788651115.858156:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651115.858166:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.858186:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651115.858199:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618aa00, rc 0) 00000100:00100000:2.0:1788651115.858269:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:0:x1875536389367936:12345-192.168.203.21@tcp:101:bash.0 Request processed in 267us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651115.858276:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1788651115.861620:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651115.861652:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389368064 00000100:00100000:1.0:1788651115.861661:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389368064 00000100:00100000:1.0:1788651115.861702:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1788651115.861712:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:10280:x1875536389368064:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1788651115.861728:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651115.861746:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c086 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.861788:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.861797:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651115.861802:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651115.861808:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.861847:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 8 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.862683:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 8 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651115.862698:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408275072:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651115.863017:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651115.868847:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408275072:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651115.869453:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651115.869486:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:2.0:1788651115.869548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651115.869721:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389368192 00000100:00100000:3.0:1788651115.869728:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389368192 00010000:00010000:3.0:1788651115.869760:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 9 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651115.869837:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:3.0:1788651115.869850:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2355:x1875536389368192:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651115.869865:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651115.869885:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 9 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.869898:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 9 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.869945:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba88797755d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c07f expref: 9 pid: 6675 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.869966:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651115.869970:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651115.869977:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.869987:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651115.870156:0:11151:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651115.870172:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11151:1875536408275200:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651115.870233:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:10280:x1875536389368064:12345-192.168.203.21@tcp:101:bash.0 Request processed in 8520us (8618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651115.870242:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1788651115.870734:0:11151:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7c266900 going to sleep for 11 seconds 00000100:00100000:3.0:1788651115.876289:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11151:1875536408275200:192.168.203.21@tcp:105: 00010000:00010000:3.0:1788651115.876313:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651115.876355:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389368192:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 6505us (6809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651115.876365:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:2.0:1788651115.878529:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651115.878581:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389368448 00000100:00100000:0.0:1788651115.878591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389368448 00000100:00100000:0.0:1788651115.878646:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1788651115.878655:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:10280:x1875536389368448:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:0.0:1788651115.879146:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10280:x1875536389368448:12345-192.168.203.21@tcp:35:bash.0 Request processed in 489us (621us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788651115.879154:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:2.0:1788651116.035360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.035800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389368704 00000100:00100000:1.0:1788651116.035810:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389368704 00000100:00100000:1.0:1788651116.035865:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1788651116.035875:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10290:x1875536389368704:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651116.035897:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.035925:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797756b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c08d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.036002:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788651116.036104:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797756b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c08d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.036142:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:1.0:1788651116.036145:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651116.036161:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797756b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c08d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.036176:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c800, rc 0) 00000100:00100000:1.0:1788651116.036240:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:10290:x1875536389368704:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 366us (888us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788651116.036247:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:2.0:1788651116.040044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651116.040143:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389368960 00000100:00100000:0.0:1788651116.040152:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389368960 00000100:00100000:0.0:1788651116.040200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1788651116.040209:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:10290:x1875536389368960:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1788651116.040417:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:10290:x1875536389368960:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 208us (380us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788651116.040424:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1788651116.178025:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.178156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389369088 00000100:00100000:1.0:1788651116.178165:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389369088 00000100:00100000:1.0:1788651116.178223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1788651116.178233:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:10296:x1875536389369088:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651116.178254:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.178275:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c094 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.178335:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.178349:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.178362:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.178393:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788651116.178396:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651116.178411:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.178434:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c094 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.178462:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c094 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.178471:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651116.178474:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651116.178478:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c200, rc 0) 00000100:00100000:1.0:1788651116.178534:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:10296:x1875536389369088:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 302us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651116.178541:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1788651116.187177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651116.187453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389369344 00000100:00100000:3.0:1788651116.187462:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389369344 00000100:00100000:3.0:1788651116.187514:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1788651116.187535:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:10296:x1875536389369344:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651116.187559:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651116.187577:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977587 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c09b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.187663:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797758e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.187677:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797758e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.187688:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797758e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651116.187792:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788651116.188074:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977587 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c09b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.188091:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797758e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c09b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.188100:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:3.0:1788651116.188103:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651116.188318:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56da00, rc 0) 00000100:00100000:3.0:1788651116.188372:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:10296:x1875536389369344:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 838us (1202us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788651116.188380:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1788651116.195323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.195437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389369600 00000100:00100000:1.0:1788651116.195447:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389369600 00000100:00100000:1.0:1788651116.195499:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1788651116.195509:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:10296:x1875536389369600:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651116.195531:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.195549:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797759c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0a2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.195634:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.195649:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.195661:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.195688:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788651116.195805:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797759c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a2 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.195834:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a2 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.195843:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:1.0:1788651116.195846:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788651116.195849:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651116.195915:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:10296:x1875536389369600:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 399us (591us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788651116.195923:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:2.0:1788651116.199671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.200031:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389369728 00000100:00100000:1.0:1788651116.200040:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389369728 00000100:00100000:1.0:1788651116.200101:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:1.0:1788651116.200125:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:2355:x1875536389369728:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651116.200140:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651116.200160:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797758e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c09b expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.200177:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:1.0:1788651116.200181:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651116.200230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:2355:x1875536389369728:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 121us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651116.200237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1788651116.233875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651116.234083:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389369856 00000100:00100000:0.0:1788651116.234093:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389369856 00000100:00100000:0.0:1788651116.234176:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1788651116.234187:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389369856:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:0.0:1788651116.234230:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.234255:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.234265:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788651116.234270:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651116.234274:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.234306:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.234321:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651116.234336:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1875536408275328:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651116.234408:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651116.237157:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1875536408275328:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651116.237186:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651116.241022:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651116.241769:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389369984 00000100:00100000:0.0:1788651116.241779:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389369984 00002000:00100000:0.0:1788651116.241822:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93be7bad0000 x1875536389369984/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:257/0 lens 504/0 e 0 to 0 dl 1788651127 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788651116.241852:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be7bad0000 with x1875536389369984 ext(0->12) 00010000:00010000:0.0:1788651116.241862:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.241879:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 8 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651116.241887:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be7bad0000 00000100:00100000:0.0:1788651116.241926:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1788651116.241935:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389369984:12345-192.168.203.21@tcp:4:lfs.0 00000001:00100000:1.0:1788651116.280607:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000001:00080000:1.0:1788651116.329425:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788651116.329586:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389369984:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 87646us (88578us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788651116.329597:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00002000:00100000:0.0:1788651116.329612:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93be7bad0000 x1875536389369984/t4294967299(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:257/0 lens 504/448 e 0 to 0 dl 1788651127 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788651116.329623:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be7bad0000 with x1875536389369984 ext(0->12) 00010000:00010000:0.0:1788651116.329633:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.329650:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651116.329658:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be7bad0000 00000100:00100000:3.0:1788651116.332531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.332630:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389370112 00000100:00100000:1.0:1788651116.332638:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389370112 00010000:00010000:1.0:1788651116.332671:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.332781:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:1.0:1788651116.332790:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389370112:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651116.332803:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788651116.332819:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788651116.332822:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788651116 00002000:00010000:1.0:1788651116.332824:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788651116 00002000:00010000:1.0:1788651116.332826:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788651116 00002000:00010000:1.0:1788651116.332828:0:5826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788651116.332834:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.332856:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.332880:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005852914a/0x84a2fba887977564 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c086 expref: 7 pid: 6672 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.332896:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651116.332900:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651116.332915:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.332937:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.332972:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651116.333075:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333090:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333127:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333136:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333144:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333151:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860a00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651116.333156:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333168:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333182:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.333189:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3d0bedc/0x84a2fba8879775b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.333285:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389370112:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 495us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651116.333292:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:0.0:1788651116.333624:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389369856:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 99439us (99758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651116.333633:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:1.0:1788651116.335714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651116.335772:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389370368 00000100:00100000:0.0:1788651116.335781:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389370368 00000100:00100000:0.0:1788651116.335827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1788651116.335835:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10296:x1875536389370368:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:0.0:1788651116.335884:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a2 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651116.336185:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788651116.336244:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788651116.336679:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788651116.336725:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.336739:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.336749:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.336777:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.336791:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 23 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651116.336816:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50495500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875536408275456:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651116.336891:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651116.341369:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.341504:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389370496 00000100:00100000:1.0:1788651116.341513:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389370496 00010000:00010000:1.0:1788651116.341548:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 24 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.341592:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:1.0:1788651116.341601:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:2356:x1875536389370496:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651116.341617:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651116.341624:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 24 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.341639:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 24 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.341660:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:1.0:1788651116.341666:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.341685:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.341693:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.341710:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651116.341771:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:2356:x1875536389370496:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 170us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651116.341784:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00010000:00010000:0.0:1788651116.344295:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c078 expref: 23 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651116.344319:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50495500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1875536408275456:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651116.344343:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.344354:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.344359:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651116.345321:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788651116.346028:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788651116.346414:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875536408275584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788651116.346483:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651116.346514:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651116.346641:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408275584 00000100:00100000:3.0:1788651116.346649:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408275584 00000100:00100000:3.0:1788651116.346710:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651116.346719:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875536408275584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788651116.346796:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875536408275584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651116.346804:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651116.346924:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875536408275584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788651116.347582:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788651116.347640:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875536408275712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788651116.347680:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651116.347705:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651116.348059:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408275712 00000100:00100000:2.0:1788651116.348065:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408275712 00000100:00100000:2.0:1788651116.348087:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788651116.348094:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875536408275712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788651116.348308:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875536408275712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 214us (627us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788651116.348315:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651116.348456:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1875536408275712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788651116.348607:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788651116.348642:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.348652:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.348660:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.348672:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651116.348677:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.348685:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.348700:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:1.0:1788651116.348703:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788651116.348708:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.348714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860800/0x84a2fba8879775b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788651116.349305:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788651116.349369:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788651116.351304:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788651116.351321:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320411212895ns, next at 321411209898ns, rc = 0 00000001:00080000:1.0:1788651116.351332:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788651116.351382:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be449aea00) 00010000:00010000:1.0:1788651116.351386:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788651116.351396:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a2 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.351901:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:10296:x1875536389370368:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 16065us (16190us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788651116.351924:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000020:00080000:1.0:1788651116.351928:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788651116.354181:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651116.354315:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389370624 00000100:00100000:0.0:1788651116.354324:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389370624 00000100:00100000:0.0:1788651116.354372:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:0.0:1788651116.354381:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:10296:x1875536389370624:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651116.354400:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651116.354420:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879775bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0a9 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.354481:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879775bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a9 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.354506:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879775bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a9 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.354525:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651116.354528:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651116.354531:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860a00, rc 0) 00000100:00100000:0.0:1788651116.354578:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:10296:x1875536389370624:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 199us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651116.354585:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:3.0:1788651116.356859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651116.356955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389370880 00000100:00100000:2.0:1788651116.356963:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389370880 00000100:00100000:2.0:1788651116.357002:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1788651116.357010:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:10296:x1875536389370880:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651116.357365:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:10296:x1875536389370880:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 355us (512us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788651116.357371:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1788651116.415716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.415895:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389371136 00000100:00100000:1.0:1788651116.415915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389371136 00000100:00100000:1.0:1788651116.415985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:1.0:1788651116.415995:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:10306:x1875536389371136:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651116.416017:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.416038:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0b0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.416168:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788651116.416282:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b0 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.416297:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:1.0:1788651116.416300:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651116.416305:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b0 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.416319:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651116.416381:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10306:x1875536389371136:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 387us (674us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788651116.416389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1788651116.421748:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651116.421844:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389371264 00000100:00100000:0.0:1788651116.421863:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389371264 00000100:00100000:0.0:1788651116.421938:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:0.0:1788651116.421960:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10306:x1875536389371264:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:0.0:1788651116.422056:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422073:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422084:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422098:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422144:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422163:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422252:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422261:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422268:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651116.422307:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422319:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422325:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422333:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422339:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651116.422345:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422353:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422365:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:0.0:1788651116.422374:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651116.422379:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422385:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba8879775d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422398:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422404:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422410:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422414:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651116.422417:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422423:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422432:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be44b46100) 00010000:00010000:0.0:1788651116.422435:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651116.422437:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422443:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879775db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422457:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422469:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422474:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422479:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651116.422482:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422487:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422495:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651116.422497:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651116.422500:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.422506:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879775e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651116.422567:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10306:x1875536389371264:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 609us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651116.422576:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:3.0:1788651116.426199:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.426450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389371520 00000100:00100000:1.0:1788651116.426460:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389371520 00000100:00100000:1.0:1788651116.426564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1788651116.426574:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10306:x1875536389371520:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651116.426876:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:10306:x1875536389371520:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 303us (684us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788651116.426899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:2.0:1788651116.458222:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.458345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389371776 00000100:00100000:1.0:1788651116.458354:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389371776 00000100:00100000:1.0:1788651116.458444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:1.0:1788651116.458456:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:10309:x1875536389371776:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651116.458478:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.458498:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0b7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458568:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458582:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458592:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458607:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458614:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458621:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458732:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458822:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.458830:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.458841:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788651116.459068:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.459077:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.459083:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.459088:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651116.459093:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.459101:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460600:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651116.460606:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651116.460612:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460621:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879775f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460639:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460657:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460664:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460669:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651116.460673:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460679:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460688:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79400) 00010000:00010000:1.0:1788651116.460690:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651116.460693:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.460698:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879775f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.462872:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879775e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.463078:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.463089:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651116.463092:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651116.463138:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c600, rc 0) 00000100:00100000:1.0:1788651116.463216:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10309:x1875536389371776:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 4761us (5002us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788651116.463225:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1788651116.466728:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.466834:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389371904 00000100:00100000:1.0:1788651116.466845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389371904 00000100:00100000:1.0:1788651116.466926:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:1.0:1788651116.466937:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10309:x1875536389371904:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1788651116.467011:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467028:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467040:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467066:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467074:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467081:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467087:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651116.467091:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467099:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467160:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651116.467163:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651116.467168:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.467174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba88797760c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.467237:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10309:x1875536389371904:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 302us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651116.467244:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1788651116.471298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651116.471692:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389372160 00000100:00100000:2.0:1788651116.471701:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389372160 00000100:00100000:2.0:1788651116.471753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:2.0:1788651116.471763:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10309:x1875536389372160:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651116.471969:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:10309:x1875536389372160:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 207us (680us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788651116.471977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:2.0:1788651116.792994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.793293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389372416 00000100:00100000:1.0:1788651116.793303:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389372416 00000100:00100000:1.0:1788651116.793358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:1.0:1788651116.793368:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:10340:x1875536389372416:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:1.0:1788651116.793403:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.793423:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0be expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.793511:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba88797761a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.793526:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba88797761a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.793537:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba88797761a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.793549:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788651116.793704:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0be expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.793723:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba88797761a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0be expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.793731:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651116.793733:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651116.793737:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651116.793796:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10340:x1875536389372416:12345-192.168.203.21@tcp:101:cat.0 Request processed in 430us (810us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788651116.793804:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1788651116.798979:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651116.799030:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651116.799171:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389372544 00000100:00100000:2.0:1788651116.799180:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389372544 00000100:00100000:2.0:1788651116.799236:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:2.0:1788651116.799246:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be460a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:2356:x1875536389372544:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651116.799261:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651116.799281:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba88797761a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0be expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651116.799302:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:2.0:1788651116.799307:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651116.799368:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be460a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:2356:x1875536389372544:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 123us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651116.799376:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1788651116.799696:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389372800 00000100:00100000:1.0:1788651116.799700:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389372800 00000100:00100000:1.0:1788651116.799732:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1788651116.799740:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:10340:x1875536389372800:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:1.0:1788651116.799942:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10340:x1875536389372800:12345-192.168.203.21@tcp:35:cat.0 Request processed in 201us (910us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788651116.799950:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00010000:00010000:2.0:1788651116.871395:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651116.874257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651116.878923:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389373056 00000100:00100000:1.0:1788651116.878937:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389373056 00000100:00100000:1.0:1788651116.879015:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:1.0:1788651116.879026:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10346:x1875536389373056:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:1.0:1788651116.879046:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651116.879050:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788651116.879074:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c094 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.879138:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651116.879143:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651116.879157:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977628 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0c5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.879239:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.879253:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.879261:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.879290:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.879304:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 35 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.879317:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408275840:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651116.879415:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651116.883655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651116.883727:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389373184 00000100:00100000:2.0:1788651116.883735:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389373184 00010000:00010000:2.0:1788651116.883769:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651116.883826:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:2.0:1788651116.883836:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:2355:x1875536389373184:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651116.883849:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651116.883855:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651116.883868:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 36 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651116.883889:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:2.0:1788651116.883894:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651116.883915:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651116.883923:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651116.883942:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651116.883995:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:2355:x1875536389373184:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 161us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651116.884007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00010000:00010000:1.0:1788651116.884173:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879775fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0b7 expref: 35 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651116.884190:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408275840:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651116.884218:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.884228:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.884234:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651116.884250:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788651116.884389:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977628 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.884402:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651116.884409:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651116.884412:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651116.884414:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c400, rc 0) 00000100:00100000:1.0:1788651116.884448:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10346:x1875536389373056:12345-192.168.203.21@tcp:101:dd.0 Request processed in 5425us (10208us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788651116.884456:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:0.0:1788651116.891897:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651116.891999:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389373440 00000100:00100000:3.0:1788651116.892008:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389373440 00000100:00100000:3.0:1788651116.892061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:3.0:1788651116.892071:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10346:x1875536389373440:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:3.0:1788651116.892316:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.892332:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651116.892343:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651116.892396:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788651116.892416:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006910f6b7 reply state 000000000551efcf transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651116.892424:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651116.892499:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:10346:x1875536389373440:12345-192.168.203.21@tcp:36:dd.0 Request processed in 430us (611us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788651116.892506:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000020:00080000:3.0:1788651116.892511:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788651116.893665:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.893678:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.893703:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.893709:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651116.893713:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.893722:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.893735:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651116.893738:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651116.893742:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651116.893749:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba88797763d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651117.212321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.212454:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389373568 00000100:00100000:3.0:1788651117.212463:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389373568 00000100:00100000:3.0:1788651117.212527:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:3.0:1788651117.212537:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+37:10360:x1875536389373568:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:3.0:1788651117.212559:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651117.212577:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0cc expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212645:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212660:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212673:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212686:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212709:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212715:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212791:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212801:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212810:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212841:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.212855:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 38 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651117.212992:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408275968:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651117.213080:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67840 going to sleep for 11 seconds 00000100:00080000:0.0:1788651117.213505:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651117.214907:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408275968:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651117.214931:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651117.217999:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651117.218080:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389373824 00000100:00100000:1.0:1788651117.218089:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389373824 00000100:00100000:1.0:1788651117.218163:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1788651117.218172:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:5590:x1875536389373824:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788651117.218493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:5590:x1875536389373824:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 320us (500us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788651117.218515:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1788651117.226280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.226434:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389373952 00000100:00100000:3.0:1788651117.226456:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389373952 00010000:00010000:3.0:1788651117.226495:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 40 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651117.226536:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:3.0:1788651117.226545:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:2355:x1875536389373952:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651117.226559:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651117.226565:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 40 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.226587:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 40 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.226610:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba88797762f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0c5 expref: 40 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.226634:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:3.0:1788651117.226639:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.226656:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.226664:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226782:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226796:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651117.226836:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788651117.226840:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651117.226879:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226912:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226922:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226930:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226936:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226942:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651117.226946:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226954:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226964:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:0.0:1788651117.226966:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651117.226970:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226977:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba88797764b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226988:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.226993:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227004:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227009:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651117.227012:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227019:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227026:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be51759600) 00010000:00010000:0.0:1788651117.227028:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651117.227031:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227037:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227070:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0cc expref: 40 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227083:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0cc expref: 39 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.227091:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651117.227093:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651117.227095:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d400, rc 0) 00000100:00100000:0.0:1788651117.227199:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:10360:x1875536389373568:12345-192.168.203.21@tcp:101:stat.0 Request processed in 14663us (14886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.227214:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00010000:00010000:3.0:1788651117.227411:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651117.227444:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:2355:x1875536389373952:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 899us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651117.227460:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:2.0:1788651117.319801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.319931:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389374208 00000100:00100000:3.0:1788651117.319941:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389374208 00000100:00100000:3.0:1788651117.319996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:3.0:1788651117.320014:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:10366:x1875536389374208:12345-192.168.203.21@tcp:36:truncate.0 00010000:00010000:3.0:1788651117.320063:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651117.320086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0cc expref: 38 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.320143:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:3.0:1788651117.320149:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651117.320503:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.320517:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.320527:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651117.320569:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788651117.320589:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e830b858 reply state 000000005f0ff6d5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651117.320598:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651117.320699:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:10366:x1875536389374208:12345-192.168.203.21@tcp:36:truncate.0 Request processed in 686us (905us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788651117.320706:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000020:00080000:3.0:1788651117.320723:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788651117.331673:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.331690:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.331699:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.331704:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651117.331708:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.331716:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.331732:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651117.331735:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651117.331740:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.331747:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651117.447609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651117.447697:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389374336 00000100:00100000:1.0:1788651117.447707:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389374336 00000100:00100000:1.0:1788651117.447761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:1.0:1788651117.447770:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:10380:x1875536389374336:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:1.0:1788651117.447796:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651117.447838:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0d3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.447919:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.447940:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.447952:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.447967:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.447974:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.447981:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448067:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448075:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448082:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651117.448139:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788651117.448143:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651117.448163:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448180:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448189:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448195:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448202:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448208:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651117.448212:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448219:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448231:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651117.448234:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651117.448238:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448245:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797766e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448258:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448264:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448274:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448280:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651117.448283:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448288:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448295:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79400) 00010000:00010000:1.0:1788651117.448297:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651117.448300:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448306:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448335:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448348:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.448356:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651117.448358:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651117.448360:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9ca00, rc 0) 00000100:00100000:1.0:1788651117.448420:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:10380:x1875536389374336:12345-192.168.203.21@tcp:101:stat.0 Request processed in 651us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651117.448436:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:2.0:1788651117.450376:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408276224:0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.450398:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408276352:0@lo:400:kworker.0 00000100:00100000:3.0:1788651117.450469:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408276480:0@lo:400:kworker.0 00000100:00100000:1.0:1788651117.450490:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.456502:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651117.456573:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651117.456584:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408276736:0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.456624:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651117.456663:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408276736 00000100:00100000:0.0:1788651117.456670:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408276736 00000100:00100000:0.0:1788651117.456717:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788651117.456725:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408276736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.456768:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408276736:12345-0@lo:400:kworker.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.456775:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788651117.456793:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651117.456821:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408276736:0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.456841:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408276352 00000100:00100000:0.0:1788651117.456844:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408276352 00000100:00100000:0.0:1788651117.456870:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788651117.456876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408276352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.456924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408276352:12345-0@lo:400:kworker.0 Request processed in 47us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.456930:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788651117.456942:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651117.456956:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408276352:0@lo:400:kworker.0 00000100:00100000:2.0:1788651117.465439:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651117.465687:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408276224 00000100:00100000:2.0:1788651117.465696:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408276224 00000100:00100000:3.0:1788651117.465707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651117.465746:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788651117.465758:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.466052:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408276480 00000100:00100000:0.0:1788651117.466068:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408276480 00000100:00100000:0.0:1788651117.466307:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788651117.466317:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.466361:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408276480:12345-0@lo:400:kworker.0 Request processed in 47us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.466368:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651117.466486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651117.466515:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be50496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408276608:0@lo:400:kworker.0 00000100:00100000:3.0:1788651117.466540:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408276480:0@lo:400:kworker.0 00000100:00100000:1.0:1788651117.466549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651117.466581:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408276608 00000100:00100000:3.0:1788651117.466585:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408276608 00000100:00100000:3.0:1788651117.466679:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788651117.466686:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408276608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651117.466727:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408276608:12345-0@lo:400:kworker.0 Request processed in 41us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651117.466734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788651117.466801:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408276096 00000100:00100000:0.0:1788651117.466806:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408276096 00000100:00100000:0.0:1788651117.466849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788651117.466857:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.466890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408276096:12345-0@lo:400:kworker.0 Request processed in 35us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.466906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788651117.466947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788651117.466958:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408276608:0@lo:400:kworker.0 00000100:00100000:2.0:1788651117.467044:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408276224:12345-0@lo:400:kworker.0 Request processed in 1288us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651117.467052:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788651117.467318:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be50497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408276224:0@lo:400:kworker.0 00000100:00080000:1.0:1788651117.467729:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651117.585093:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.585310:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389374592 00000100:00100000:3.0:1788651117.585320:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389374592 00000100:00100000:3.0:1788651117.585379:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:3.0:1788651117.585390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:10390:x1875536389374592:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651117.585410:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651117.585430:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651117.585530:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788651117.585658:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977683 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0da expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.585672:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:3.0:1788651117.585676:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651117.585681:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0da expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.585713:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d400, rc 0) 00000100:00100000:3.0:1788651117.585776:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:10390:x1875536389374592:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 386us (690us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788651117.585783:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:2.0:1788651117.592221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651117.592328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389374848 00000100:00100000:1.0:1788651117.592339:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389374848 00000100:00100000:1.0:1788651117.592397:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:1.0:1788651117.592409:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:10390:x1875536389374848:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651117.592645:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:10390:x1875536389374848:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 237us (431us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788651117.592653:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:2.0:1788651117.708026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.708278:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389375104 00000100:00100000:3.0:1788651117.708288:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389375104 00000100:00100000:3.0:1788651117.708343:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:3.0:1788651117.708354:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:10396:x1875536389375104:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651117.708375:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651117.708394:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977691 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0e1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.708481:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.708495:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.708503:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.708533:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.708545:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 43 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651117.708579:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408276864:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651117.708698:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651117.723354:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.723475:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408276864:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651117.723504:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651117.724409:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389375232 00000100:00100000:0.0:1788651117.724418:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389375232 00010000:00010000:0.0:1788651117.724459:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 44 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651117.724509:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:0.0:1788651117.724519:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+44:2355:x1875536389375232:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651117.724534:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651117.724554:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 44 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.724567:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 44 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.724590:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797767c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0d3 expref: 44 pid: 5841 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.724607:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651117.724611:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.724620:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.724627:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.724657:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651117.724710:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:2355:x1875536389375232:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 193us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.724717:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00010000:00010000:1.0:1788651117.725152:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.725161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651117.725179:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788651117.725328:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977691 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.725343:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.725362:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651117.725365:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651117.725368:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d800, rc 0) 00000100:00100000:1.0:1788651117.725407:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:10396:x1875536389375104:12345-192.168.203.21@tcp:101:bash.0 Request processed in 17054us (17389us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788651117.725415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:1.0:1788651117.733992:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.734731:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389375488 00000100:00100000:3.0:1788651117.734753:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389375488 00000100:00100000:3.0:1788651117.734849:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:3.0:1788651117.734871:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:10396:x1875536389375488:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:3.0:1788651117.735437:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.735454:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.735465:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651117.735517:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788651117.735544:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000120dd0bb reply state 000000006bf2e25f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651117.735552:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651117.735766:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:10396:x1875536389375488:12345-192.168.203.21@tcp:36:bash.0 Request processed in 896us (1798us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788651117.735774:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000020:00080000:3.0:1788651117.735792:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788651117.747181:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.747199:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.747207:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.747214:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651117.747218:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.747226:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.747243:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:2.0:1788651117.747245:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651117.747251:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.747276:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879776a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651117.768414:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651117.775222:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389375616 00000100:00100000:3.0:1788651117.775238:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389375616 00000100:00100000:3.0:1788651117.776042:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:3.0:1788651117.776056:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:10396:x1875536389375616:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651117.777731:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651117.777763:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879776ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0e8 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.777870:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.777886:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.777903:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.777947:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.777963:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 46 pid: 5842 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651117.777977:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74fcf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408276992:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651117.778072:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788651117.783931:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74fcf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408276992:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651117.784650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:1.0:1788651117.784972:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651117.785162:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389375744 00000100:00100000:2.0:1788651117.785170:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389375744 00010000:00010000:2.0:1788651117.785206:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 47 pid: 5842 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651117.785367:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:2.0:1788651117.785378:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:2354:x1875536389375744:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651117.785392:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651117.785399:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 47 pid: 5842 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.785412:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 47 pid: 5842 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.785956:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977698 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e1 expref: 47 pid: 5842 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.785974:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:2.0:1788651117.785979:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.785989:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.785997:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651117.786028:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651117.786103:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651117.786141:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651117.786195:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:2354:x1875536389375744:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 816us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651117.786204:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000004:00200000:3.0:1788651117.786571:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788651117.786579:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651117.786694:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.786749:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba8879776ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e8 expref: 46 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.786783:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e8 expref: 45 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.786791:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651117.786794:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651117.786797:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b600, rc 0) 00000100:00100000:0.0:1788651117.786858:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:10396:x1875536389375616:12345-192.168.203.21@tcp:101:bash.0 Request processed in 10806us (18457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.786870:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:0.0:1788651117.806934:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651117.807077:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389376000 00000100:00100000:2.0:1788651117.807141:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389376000 00000100:00100000:2.0:1788651117.807208:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1788651117.807220:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:10396:x1875536389376000:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1788651117.807526:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:10396:x1875536389376000:12345-192.168.203.21@tcp:35:bash.0 Request processed in 306us (604us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788651117.807536:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:3.0:1788651117.894539:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651117.944301:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651117.944405:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389376256 00000100:00100000:0.0:1788651117.944415:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389376256 00000100:00100000:0.0:1788651117.944484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1788651117.944494:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:10406:x1875536389376256:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651117.944516:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651117.944546:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba8879776bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651117.944632:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788651117.944754:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba8879776bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0ef expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.944769:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:0.0:1788651117.944772:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651117.944777:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba8879776bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0ef expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651117.944811:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860000, rc 0) 00000100:00100000:0.0:1788651117.944869:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10406:x1875536389376256:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 376us (578us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788651117.944877:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:3.0:1788651117.948941:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651117.949297:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389376384 00000100:00100000:1.0:1788651117.949307:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389376384 00000100:00100000:1.0:1788651117.949364:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1788651117.949373:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10406:x1875536389376384:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:1.0:1788651117.949437:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949453:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949750:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949768:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949792:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949800:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949883:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949892:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949910:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651117.949949:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949962:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949969:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949976:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949982:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651117.949986:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.949994:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950014:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651117.950017:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651117.950022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950028:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879776c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950041:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950048:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950053:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950058:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651117.950061:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950067:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950075:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79400) 00010000:00010000:1.0:1788651117.950077:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651117.950080:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879776d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950151:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950260:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950305:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950310:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651117.950314:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950320:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950329:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651117.950331:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651117.950334:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651117.950340:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879776d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651117.950617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10406:x1875536389376384:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 1243us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651117.950625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:2.0:1788651117.954968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651117.955306:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389376640 00000100:00100000:1.0:1788651117.955316:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389376640 00000100:00100000:1.0:1788651117.955376:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651117.955399:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10406:x1875536389376640:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651117.955759:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+48:10406:x1875536389376640:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 361us (798us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788651117.955767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:0.0:1788651117.962614:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408277120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651117.962690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651117.962774:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408277120 00000100:00100000:0.0:1788651117.962781:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408277120 00000100:00100000:0.0:1788651117.962826:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788651117.962836:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408277120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651117.962872:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651117.962928:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408277120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651117.962934:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788651117.962983:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408277120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651118.026080:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.027483:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389376896 00000100:00100000:0.0:1788651118.027495:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389376896 00000100:00100000:0.0:1788651118.027569:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:0.0:1788651118.027580:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+48:10409:x1875536389376896:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651118.027609:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651118.027630:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba8879776de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0f6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027703:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027730:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027742:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027758:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027765:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027772:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027884:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879776f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027902:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879776f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.027910:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879776f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651118.027919:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788651118.028007:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028016:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028022:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028034:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651118.028039:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028047:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028058:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:0.0:1788651118.028061:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651118.028066:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028072:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879776e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028085:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028091:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028157:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028163:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651118.028166:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028172:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028190:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be44b46100) 00010000:00010000:0.0:1788651118.028193:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651118.028196:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028203:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba8879776ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028244:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba8879776de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0f6 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028259:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879776f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0f6 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.028267:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651118.028270:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651118.028272:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861200, rc 0) 00000100:00100000:0.0:1788651118.028337:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10409:x1875536389376896:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 758us (2265us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788651118.028345:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1788651118.032192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651118.032493:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389377024 00000100:00100000:2.0:1788651118.032502:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389377024 00000100:00100000:2.0:1788651118.032560:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1788651118.032571:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10409:x1875536389377024:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:2.0:1788651118.032637:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032653:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032663:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032702:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032708:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032714:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032731:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651118.032735:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032743:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032754:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:2.0:1788651118.032758:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651118.032763:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.032769:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651118.032844:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10409:x1875536389377024:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 275us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651118.032851:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1788651118.036000:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.036069:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389377280 00000100:00100000:0.0:1788651118.036078:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389377280 00000100:00100000:0.0:1788651118.036161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1788651118.036172:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10409:x1875536389377280:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1788651118.036371:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:10409:x1875536389377280:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 201us (379us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788651118.036379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1788651118.036669:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651118.036806:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389377408 00000100:00100000:2.0:1788651118.036811:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389377408 00000100:00100000:2.0:1788651118.036850:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1788651118.036858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:2356:x1875536389377408:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651118.036869:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651118.036890:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879776f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0f6 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.036917:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:2.0:1788651118.036929:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651118.036962:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:2356:x1875536389377408:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651118.036968:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1788651118.257143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.257300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389377664 00000100:00100000:1.0:1788651118.257311:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389377664 00000100:00100000:1.0:1788651118.257404:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:1.0:1788651118.257415:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10427:x1875536389377664:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:1.0:1788651118.257439:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.257470:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977708 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c0fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.257565:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797770f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.257579:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797770f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.257590:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797770f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651118.257602:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788651118.257741:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977708 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0fd expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.257759:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797770f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0fd expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.257785:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651118.257788:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788651118.257792:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:1.0:1788651118.257856:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10427:x1875536389377664:12345-192.168.203.21@tcp:101:cat.0 Request processed in 444us (755us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788651118.257863:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1788651118.283800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.283908:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389377792 00000100:00100000:1.0:1788651118.283918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389377792 00000100:00100000:1.0:1788651118.283975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:1.0:1788651118.283985:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10428:x1875536389377792:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651118.284008:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.284028:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797771d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c104 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.284142:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977724 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.284157:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.284168:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651118.284203:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788651118.284207:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651118.284222:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.284261:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797771d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c104 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.284281:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c104 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.284290:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651118.284293:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651118.284297:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c600, rc 0) 00000100:00100000:1.0:1788651118.284357:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10428:x1875536389377792:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 374us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.284365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:2.0:1788651118.306972:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.307071:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378176 00000100:00100000:0.0:1788651118.307081:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378176 00000100:00100000:0.0:1788651118.307157:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:0.0:1788651118.307167:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10428:x1875536389378176:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1788651118.307486:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10428:x1875536389378176:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 319us (522us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788651118.307493:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:3.0:1788651118.309553:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.309621:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378304 00000100:00100000:1.0:1788651118.309631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378304 00000100:00100000:1.0:1788651118.309690:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1788651118.309701:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10428:x1875536389378304:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:1.0:1788651118.309715:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788651118.309740:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba8879776b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0e8 expref: 54 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.309764:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797770f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0fd expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.309777:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879775bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c0a9 expref: 52 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.309805:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:1.0:1788651118.309817:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651118.309873:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:10428:x1875536389378304:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 174us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.309881:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:2.0:1788651118.315969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.316401:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378432 00000100:00100000:1.0:1788651118.316411:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378432 00000100:00100000:1.0:1788651118.316570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:1.0:1788651118.316583:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:10428:x1875536389378432:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:1.0:1788651118.316713:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.316729:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.316743:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651118.317061:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788651118.317292:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788651118.317355:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788651118.317443:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:10428:x1875536389378432:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 862us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.323984:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:0.0:1788651118.338790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.338915:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378560 00000100:00100000:1.0:1788651118.338924:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378560 00000100:00100000:1.0:1788651118.338984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:1.0:1788651118.338994:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:10430:x1875536389378560:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651118.339025:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.339044:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977732 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c10b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339135:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339150:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339162:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339177:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339184:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339190:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339269:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339277:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339284:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651118.339318:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788651118.339330:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651118.339352:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339363:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339371:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339379:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339386:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339392:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651118.339397:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339405:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339417:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651118.339420:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651118.339425:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339445:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339531:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339537:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339543:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651118.339546:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339552:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339560:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79800) 00010000:00010000:1.0:1788651118.339563:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651118.339565:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339571:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339603:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977732 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339616:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.339623:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:1.0:1788651118.339626:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651118.339634:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c800, rc 0) 00000100:00100000:1.0:1788651118.339740:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10430:x1875536389378560:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 747us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.339746:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000040:00080000:1.0:1788651118.468468:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651118.468479:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651118.468543:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788651118.468549:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651118.468672:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408277248:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651118.468785:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651118.472280:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408277248:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651118.486284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.486789:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378688 00000100:00100000:1.0:1788651118.486798:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378688 00000100:00100000:1.0:1788651118.486851:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:1.0:1788651118.486861:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389378688:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788651118.486954:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389378688:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 Request processed in 94us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.486961:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1788651118.503997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.505293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378816 00000100:00100000:3.0:1788651118.505306:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378816 00000100:00100000:3.0:1788651118.505367:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:3.0:1788651118.505377:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389378816:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651118.505407:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651118.505519:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389378816:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 143us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.505526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:2.0:1788651118.512078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.512335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389378944 00000100:00100000:1.0:1788651118.512344:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389378944 00000100:00100000:1.0:1788651118.512398:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1788651118.512408:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389378944:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.512472:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512489:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512508:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512523:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512529:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512536:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512560:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512567:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512574:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651118.512615:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788651118.512620:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651118.512634:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512644:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512651:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512666:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.512672:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651118.513225:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513238:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513251:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:1.0:1788651118.513254:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651118.513259:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797774e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513279:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513286:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513292:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513297:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651118.513300:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513316:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513325:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93be58f79800) 00010000:00010000:1.0:1788651118.513328:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651118.513330:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513337:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977755 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513352:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513358:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513364:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513369:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651118.513371:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513377:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513384:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:1.0:1788651118.513386:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651118.513389:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.513404:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba88797775c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.513514:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389378944:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 1105us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.513523:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:3.0:1788651118.515564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.515695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389379200 00000100:00100000:1.0:1788651118.515703:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389379200 00000100:00100000:1.0:1788651118.515785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1788651118.515795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10441:x1875536389379200:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.515812:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.515829:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977763 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c112 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.515929:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.515943:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.515954:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651118.515974:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788651118.516064:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516071:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516088:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516094:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651118.516099:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516134:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516146:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:1.0:1788651118.516149:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651118.516154:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516161:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797776a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516200:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977763 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c112 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516222:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:1.0:1788651118.516224:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651118.516229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977763 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c112 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.516240:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651118.516297:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10441:x1875536389379200:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 504us (739us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788651118.516314:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:3.0:1788651118.518790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651118.518935:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389379328 00000100:00100000:2.0:1788651118.518945:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389379328 00000100:00100000:2.0:1788651118.519001:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:2.0:1788651118.519010:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10441:x1875536389379328:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651118.519052:0:5871:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651118.519168:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10441:x1875536389379328:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 159us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651118.519176:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:3.0:1788651118.524070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651118.524357:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389379584 00000100:00100000:2.0:1788651118.524366:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389379584 00000100:00100000:2.0:1788651118.524428:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:2.0:1788651118.524438:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10441:x1875536389379584:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651118.524457:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651118.524460:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651118.524484:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977724 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c104 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.524503:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:2.0:1788651118.524508:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651118.524520:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977778 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c119 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651118.524912:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788651118.525104:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba88797777f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.525140:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba88797777f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.525221:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba88797777f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.525273:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977778 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c119 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.525288:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba88797777f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c119 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.525296:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449aee00) 00010000:00010000:2.0:1788651118.525298:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651118.525301:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b600, rc 0) 00000100:00100000:2.0:1788651118.525363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10441:x1875536389379584:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 926us (1299us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788651118.525371:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:2.0:1788651118.537032:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.537144:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389379840 00000100:00100000:3.0:1788651118.537162:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389379840 00000100:00100000:3.0:1788651118.537210:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:3.0:1788651118.537221:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10441:x1875536389379840:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651118.537275:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651118.537301:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba88797777f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c119 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537320:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449aee00) 00010000:00010000:3.0:1788651118.537331:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651118.537354:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537368:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537377:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537415:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537423:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537429:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537493:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537514:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537519:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537525:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56da00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651118.537529:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537538:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537547:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651118.537549:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651118.537553:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537559:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba88797778d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537568:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537573:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537579:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537584:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651118.537593:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537599:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537608:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9f638c64 (ffff93be51759e00) 00010000:00010000:3.0:1788651118.537610:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651118.537613:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.537618:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977794 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f638c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.537840:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10441:x1875536389379840:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 476us (673us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651118.537849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:1.0:1788651118.541603:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651118.541743:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389379968 00000100:00100000:2.0:1788651118.541752:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389379968 00000100:00100000:2.0:1788651118.541801:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:2.0:1788651118.541811:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10441:x1875536389379968:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651118.541837:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651118.541860:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba88797779b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c120 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.541903:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.541917:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.541929:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.542014:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba88797779b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.542029:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.542038:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:2.0:1788651118.542041:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651118.542044:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618aa00, rc 0) 00000100:00100000:2.0:1788651118.542159:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10441:x1875536389379968:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 349us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651118.542166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:2.0:1788651118.545507:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.547807:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389380224 00000100:00100000:1.0:1788651118.547823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389380224 00000100:00100000:1.0:1788651118.548952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:1.0:1788651118.548966:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10441:x1875536389380224:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.549051:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.549068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.549080:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651118.549377:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788651118.549387:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322609279079ns, next at 323609276968ns, rc = 0 00000004:00010000:1.0:1788651118.549469:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebca4115 reply state 00000000fc30ddb6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.549477:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651118.549573:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10441:x1875536389380224:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 610us (4072us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788651118.549580:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00010000:00010000:2.0:1788651118.554511:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.554535:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.554543:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.554549:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651118.554553:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.554561:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.554578:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:2.0:1788651118.554580:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788651118.554585:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.554592:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba8879777a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651118.560028:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.560135:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389380352 00000100:00100000:1.0:1788651118.560143:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389380352 00000100:00100000:1.0:1788651118.560204:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1788651118.560215:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10441:x1875536389380352:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.560243:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.560263:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c127 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.560317:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.560333:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.560352:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:1.0:1788651118.560356:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651118.560359:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670400, rc 0) 00000100:00100000:1.0:1788651118.560410:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10441:x1875536389380352:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 196us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.560418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1788651118.569246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.569290:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389380480 00000100:00100000:0.0:1788651118.569301:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389380480 00000100:00100000:0.0:1788651118.569353:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:0.0:1788651118.569362:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1875536389380480:12345-192.168.203.21@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788651118.569394:0:10263:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:0.0:1788651118.569428:0:10263:0:(genops.c:1385:class_connect()) connect: client f051ebe0-0677-425e-9b9b-54befcd9fd1c, cookie 0x84a2fba8879777b7 00002000:00100000:0.0:1788651118.569441:0:10263:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f051ebe0-0677-425e-9b9b-54befcd9fd1c/ffff93be45402800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651118.569452:0:10263:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651118.569920:0:10263:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788651118.569950:0:10263:0:(import.c:65:import_set_state_nolock()) ffff93be45407000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651118.570020:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2352:x1875536389380480:12345-192.168.203.21@tcp:8:lhsmtool_posix.0 Request processed in 657us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651118.570030:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:1.0:1788651118.575264:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.575325:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389380608 00000100:00100000:0.0:1788651118.575334:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389380608 00000100:00100000:0.0:1788651118.575408:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:0.0:1788651118.575419:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:0:x1875536389380608:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788651118.575693:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651118.615934:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:0:x1875536389380608:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 40505us (40667us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788651118.615953:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000001:00080000:1.0:1788651118.616023:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1788651118.616032:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000100:00100000:3.0:1788651118.618530:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.618599:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389380864 00000100:00100000:1.0:1788651118.618609:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389380864 00000100:00100000:1.0:1788651118.618664:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:1.0:1788651118.618675:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10441:x1875536389380864:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788651118.618919:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10441:x1875536389380864:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 245us (396us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788651118.618936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1788651118.623419:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.623498:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389381120 00000100:00100000:3.0:1788651118.623508:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389381120 00000100:00100000:3.0:1788651118.623565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:3.0:1788651118.623574:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10441:x1875536389381120:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651118.623731:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10441:x1875536389381120:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.623739:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:2.0:1788651118.632144:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.632917:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389381248 00000100:00100000:1.0:1788651118.632993:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389381248 00000100:00100000:1.0:1788651118.633055:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:1.0:1788651118.633067:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10441:x1875536389381248:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.633088:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.633142:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879777be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c12e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.634241:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879777c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.634260:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879777c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.634272:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879777c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651118.634306:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651118.634325:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879777c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.634350:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879777be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c12e expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.634369:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879777c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c12e expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.634379:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:0.0:1788651118.634381:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788651118.634385:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860600, rc 0) 00000100:00100000:0.0:1788651118.634446:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:10441:x1875536389381248:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1381us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651118.634463:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:2.0:1788651118.639656:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.639772:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389381376 00000100:00100000:1.0:1788651118.639781:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389381376 00000100:00100000:1.0:1788651118.639833:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:1.0:1788651118.639847:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2353:x1875536389381376:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.639871:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651118.639907:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c135 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651118.640091:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca66f, blocks: 0x1 00010000:00010000:1.0:1788651118.640148:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1788651118.640154:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651118.640264:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.640351:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.640377:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41671400, rc 0) 00000100:00100000:1.0:1788651118.640429:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389381376:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 586us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.640436:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:2.0:1788651118.646197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.646345:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389381632 00000100:00100000:1.0:1788651118.646355:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389381632 00000100:00100000:1.0:1788651118.646409:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:1.0:1788651118.646419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:10441:x1875536389381632:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788651118.646748:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:10441:x1875536389381632:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 328us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.646756:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:2.0:1788651118.654905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.655495:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389381760 00000100:00100000:3.0:1788651118.655505:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389381760 00000100:00100000:3.0:1788651118.655592:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1788651118.655603:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:10441:x1875536389381760:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651118.655632:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651118.655652:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c13c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.655694:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.655704:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651118.655708:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651118.655713:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.655745:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.655758:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.655772:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1875536408277376:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651118.655858:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651118.662430:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d515180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1875536408277376:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651118.662464:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.662486:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d200, rc 0) 00000100:00100000:3.0:1788651118.662544:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:10441:x1875536389381760:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 6943us (7657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.662553:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:2.0:1788651118.671504:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.671624:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389381888 00000100:00100000:0.0:1788651118.671634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389381888 00010000:00010000:0.0:1788651118.671686:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651118.671727:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:0.0:1788651118.671737:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389381888:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651118.671749:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651118.671770:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.671784:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.671807:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000014c2be5/0x84a2fba8879777cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c135 expref: 7 pid: 6672 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.671825:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651118.671829:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651118.671837:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.671847:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.671907:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651118.671921:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1875536408277504:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651118.671996:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651118.680342:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1875536408277504:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651118.680368:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651118.680413:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389381888:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 8677us (8918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651118.680423:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:2.0:1788651118.683986:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.687050:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389382016 00000100:00100000:3.0:1788651118.687065:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389382016 00002000:00100000:3.0:1788651118.687135:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93be7bfd2a00 x1875536389382016/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:259/0 lens 504/0 e 0 to 0 dl 1788651129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651118.687147:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be7bfd2a00 with x1875536389382016 ext(0->8) 00002000:00010000:3.0:1788651118.687153:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be7bfd2a00 00000100:00100000:3.0:1788651118.687185:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1788651118.687195:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389382016:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788651118.687783:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389382016:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 588us (3805us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788651118.687791:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00002000:00100000:3.0:1788651118.687798:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93be7bfd2a00 x1875536389382016/t4294967302(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:259/0 lens 504/448 e 0 to 0 dl 1788651129 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651118.687807:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be7bfd2a00 with x1875536389382016 ext(0->8) 00002000:00010000:3.0:1788651118.687810:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be7bfd2a00 00000100:00100000:2.0:1788651118.691928:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.692317:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389382144 00000100:00100000:3.0:1788651118.692327:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389382144 00000100:00100000:3.0:1788651118.692380:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:3.0:1788651118.692393:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:10441:x1875536389382144:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788651118.735652:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:10441:x1875536389382144:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 43253us (43721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.735677:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00000001:00080000:0.0:1788651118.737607:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:0.0:1788651118.737643:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788651118.737650:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1788651118.737686:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788651118.737704:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be503fe840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788651118.737709:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be7bcc4700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93be503fe480 00000020:00080000:0.0:1788651118.737712:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be7bcc4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be7c00d000 00000020:00080000:0.0:1788651118.737762:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788651118.738662:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788651118.738686:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be765e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408277632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788651118.738854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651118.738936:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408277632 00000100:00100000:0.0:1788651118.738944:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408277632 00000100:00100000:0.0:1788651118.739006:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788651118.739016:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408277632:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788651118.739098:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651118.739151:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651118.739161:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7ba79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408277760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788651118.739188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651118.739262:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408277760 00000100:00100000:2.0:1788651118.739267:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408277760 00000100:00100000:2.0:1788651118.739305:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651118.739314:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408277760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788651118.739433:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788651118.739436:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788651119 00002000:00010000:2.0:1788651118.739439:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788651118.739441:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788651119 -> 1788651119 00002000:00010000:2.0:1788651118.739444:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788651118.739479:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408277760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (290us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788651118.739487:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00002000:00080000:0.0:1788651118.740037:0:10263:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788651118.740820:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ca66c, atime: 0x6a9ca66c, ctime: 0x6a9ca66c, blocks: 0xb 00010000:00010000:0.0:1788651118.740829:0:10263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.741143:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1788651118.741148:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651118.741155:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.741173:0:10263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.741185:0:10263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.741194:0:10263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.741211:0:10263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788651118.741595:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be7ba79c00/2, rc 0, transno 4294967303 00010000:00010000:2.0:1788651118.741596:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651118.741606:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.741608:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7ba79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408277760:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788651118.741621:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861e00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651118.741627:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.741637:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.741653:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.741661:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007639e886/0x84a2fba8879777da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.741688:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651118.741690:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651118.741692:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651118.744247:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.744770:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875536408277632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5753us (5913us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788651118.744781:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788651118.744806:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389382272 00000100:00100000:0.0:1788651118.744812:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389382272 00000100:00100000:0.0:1788651118.744857:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:0.0:1788651118.744865:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389382272:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788651118.746847:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be765e7b80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788651118.746861:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be765e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408277632:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788651118.824463:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788651118.824712:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389382272:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 79842us (80466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651118.824735:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000001:00080000:0.0:1788651118.824767:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788651118.838674:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.838762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389382528 00000100:00100000:1.0:1788651118.838772:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389382528 00000100:00100000:1.0:1788651118.838836:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:1.0:1788651118.838846:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10441:x1875536389382528:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.838918:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651118.838943:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba8879777c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c12e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.838961:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:1.0:1788651118.838966:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651118.838995:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.839009:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.839019:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651118.839270:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f9ad557 reply state 0000000000e16bce transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.839281:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651118.839369:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:10441:x1875536389382528:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 524us (704us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788651118.839376:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00010000:00010000:3.0:1788651118.845598:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.845616:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.845624:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.845630:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651118.845636:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.845645:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.845662:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:3.0:1788651118.845665:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651118.845670:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.845685:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879777e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.848014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.848258:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389382656 00000100:00100000:1.0:1788651118.848268:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389382656 00000100:00100000:1.0:1788651118.848317:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:1.0:1788651118.848326:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389382656:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788651118.848553:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788651118.848556:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788651119 -> 1788651118 00002000:00010000:1.0:1788651118.848559:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788651116 00002000:00010000:1.0:1788651118.848568:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788651119 -> 1788651118 00002000:00010000:1.0:1788651118.848570:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788651118.848624:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389382656:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 298us (617us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788651118.848632:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:1.0:1788651118.852409:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651118.852478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389382912 00000100:00100000:2.0:1788651118.852486:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389382912 00000100:00100000:2.0:1788651118.852535:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1788651118.852545:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10441:x1875536389382912:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788651118.852607:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.852623:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.852633:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.852665:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651118.852678:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 13 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651118.852692:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7ba7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408277888:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651118.852917:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651118.860151:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7ba7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408277888:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651118.860177:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651118.860606:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.863022:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389383040 00000100:00100000:1.0:1788651118.863034:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389383040 00010000:00010000:1.0:1788651118.863074:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.863167:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:1.0:1788651118.863177:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:2356:x1875536389383040:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651118.863200:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651118.863207:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.863219:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.863239:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879777a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c120 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.863254:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:1.0:1788651118.863258:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.863268:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.863288:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.863313:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651118.863363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2356:x1875536389383040:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 188us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.863370:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00010000:00010000:3.0:1788651118.863419:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863428:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863463:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863470:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863477:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863483:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651118.863486:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863493:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863502:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:3.0:1788651118.863505:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788651118.863508:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.863514:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba8879777e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.863552:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:10441:x1875536389382912:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 11008us (11150us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788651118.863560:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1788651118.881280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.881360:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389383168 00000100:00100000:1.0:1788651118.881370:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389383168 00000100:00100000:1.0:1788651118.881430:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:1.0:1788651118.881441:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2353:x1875536389383168:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788651118.881484:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.881504:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.881513:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651118.881517:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651118.881521:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.881553:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.881566:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 7 pid: 6674 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.881589:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6672:1875536408278016:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651118.881657:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be50d52480 going to sleep for 11 seconds 00000100:00100000:0.0:1788651118.888608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.888681:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389383296 00000100:00100000:3.0:1788651118.888690:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389383296 00010000:00010000:3.0:1788651118.888729:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 8 pid: 6674 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.888779:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:3.0:1788651118.888789:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389383296:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651118.888805:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651118.888840:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 8 pid: 6674 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.888855:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 8 pid: 6674 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.888883:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651118.888896:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651118.888903:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.888914:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.888943:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651118.888991:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389383296:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 204us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.888999:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00010000:00010000:1.0:1788651118.889415:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879777d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c13c expref: 7 pid: 6674 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.889429:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6672:1875536408278016:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651118.889448:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889458:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889465:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889489:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889498:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889506:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889524:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671c00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651118.889529:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889538:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889551:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.889559:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba8879777ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.889605:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389383168:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 8167us (8335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651118.889613:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:1.0:1788651118.898538:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651118.898577:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389383552 00000100:00100000:0.0:1788651118.898586:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389383552 00000100:00100000:0.0:1788651118.898635:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:0.0:1788651118.898643:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:10441:x1875536389383552:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788651118.898715:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.898838:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.898849:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.899303:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.899316:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.899325:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.899368:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.899381:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 13 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651118.899396:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408278144:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651118.899476:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be50d52480 going to sleep for 11 seconds 00000100:00100000:1.0:1788651118.907494:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408278144:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651118.907523:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651118.911237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.911467:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389383680 00000100:00100000:3.0:1788651118.911478:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389383680 00010000:00010000:3.0:1788651118.911516:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.911575:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:3.0:1788651118.911585:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:2356:x1875536389383680:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651118.911600:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651118.911607:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.911620:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.911641:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879777b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c127 expref: 14 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.911656:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:3.0:1788651118.911661:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.911670:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.911687:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.911717:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651118.911758:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2356:x1875536389383680:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 175us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.911765:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00010000:00010000:0.0:1788651118.913043:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.913057:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651118.913240:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788651118.913368:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788651118.913412:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788651118.913510:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875536408278272:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788651118.913574:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651118.913602:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c733c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651118.913674:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408278272 00000100:00100000:2.0:1788651118.913681:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408278272 00000100:00100000:2.0:1788651118.913715:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651118.913723:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875536408278272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788651118.913796:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875536408278272:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651118.913803:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651118.914341:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788651118.914353:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be7ba79c00, transno 4294967303 00000100:00100000:0.0:1788651118.914369:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875536408278272:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788651118.914797:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788651118.916310:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875536408278400:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788651118.916372:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651118.916406:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be43ee10c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788651118.916454:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651118.916754:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408278400 00000100:00100000:3.0:1788651118.916767:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408278400 00000100:00100000:3.0:1788651118.916823:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651118.916833:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875536408278400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788651118.917051:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875536408278400:12345-0@lo:1000:mdt00_001.0 Request processed in 220us (678us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788651118.917059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651118.917620:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1875536408278400:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788651118.917655:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917665:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917672:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917687:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651118.917692:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917699:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917712:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be449ae500) 00010000:00010000:0.0:1788651118.917715:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651118.917720:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917726:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba8879777fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917768:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917774:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917780:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917785:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651118.917788:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917795:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917802:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:0.0:1788651118.917804:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651118.917807:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917821:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba88797772b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917840:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917854:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917862:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917900:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.917914:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 16 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651118.917935:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75802300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408278528:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651118.918218:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651118.922617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651118.922682:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389383808 00000100:00100000:3.0:1788651118.922691:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389383808 00010000:00010000:3.0:1788651118.922727:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651118.922770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1788651118.922780:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:2356:x1875536389383808:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651118.922794:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651118.922801:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.922822:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 17 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.922844:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:3.0:1788651118.922849:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.922858:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.922865:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.922905:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651118.922967:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:2356:x1875536389383808:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 179us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651118.922976:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00010000:00010000:0.0:1788651118.923544:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c10b expref: 16 pid: 5842 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651118.923561:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75802300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408278528:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651118.923583:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923593:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923599:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923610:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923617:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923623:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923636:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651118.923640:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923648:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923656:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:0.0:1788651118.923659:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651118.923663:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923668:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977804 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923684:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923689:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923694:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923699:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651118.923701:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923707:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923724:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79400) 00010000:00010000:0.0:1788651118.923726:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651118.923729:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651118.923734:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba8879777f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651118.924350:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651118.924355:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651118.924381:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788651118.924388:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651118.924577:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:10441:x1875536389383552:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 25932us (26046us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788651118.924587:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000020:00080000:0.0:1788651118.924591:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788651118.929005:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651118.929276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389384064 00000100:00100000:1.0:1788651118.929287:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389384064 00000100:00100000:1.0:1788651118.929338:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651118.929348:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:10441:x1875536389384064:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788651118.929990:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788651118.930103:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788651118.930163:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.930180:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.930191:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.930212:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.930218:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.930225:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651118.930248:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651118.930332:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:10441:x1875536389384064:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 984us (1334us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788651118.930340:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000020:00080000:1.0:1788651118.930344:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788651118.930462:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651118.930469:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.930475:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670e00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651118.930479:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.930487:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.930498:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93be58f79800) 00010000:00010000:3.0:1788651118.930501:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788651118.930506:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.930512:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797780b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651118.930529:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651118.930531:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651118.930533:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651119.106702:0:11985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651119.106716:0:11985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651119.106755:0:11985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788651119.106760:0:11985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651119.241858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.241930:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389384320 00000100:00100000:1.0:1788651119.241942:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389384320 00000100:00100000:1.0:1788651119.242026:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:1.0:1788651119.242039:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:10451:x1875536389384320:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651119.242064:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651119.242156:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba887977812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c143 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.242259:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba887977819 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.242276:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba887977819 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.242290:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba887977819 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651119.242319:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:3.0:1788651119.242341:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651119.242472:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba887977812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c143 expref: 20 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.242494:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba887977819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c143 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.242505:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651119.242508:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651119.242512:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670200, rc 0) 00000100:00100000:1.0:1788651119.242639:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10451:x1875536389384320:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 603us (832us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788651119.242646:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:1.0:1788651119.247668:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.247714:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389384448 00000100:00100000:3.0:1788651119.247723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389384448 00000100:00100000:3.0:1788651119.247789:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:3.0:1788651119.247847:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10451:x1875536389384448:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1788651119.247941:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.247970:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.247983:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248238:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248249:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248304:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248534:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248543:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248550:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651119.248597:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248610:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248616:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248623:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248629:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56da00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.248633:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248640:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248652:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651119.248655:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651119.248659:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248666:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248742:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248749:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248759:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248765:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.248767:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248773:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248781:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be51759e00) 00010000:00010000:3.0:1788651119.248783:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651119.248786:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248791:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797782e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248804:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248809:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248815:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248819:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.248822:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248838:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248846:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be51759900) 00010000:00010000:3.0:1788651119.248848:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651119.248851:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.248855:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651119.248948:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10451:x1875536389384448:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 1149us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.248968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:3.0:1788651119.301896:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.302141:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389384704 00000100:00100000:1.0:1788651119.302150:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389384704 00000100:00100000:1.0:1788651119.302211:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:1.0:1788651119.302220:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10454:x1875536389384704:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651119.302239:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651119.302258:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797783c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c14a expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302325:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302340:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302371:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302388:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302395:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302402:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302662:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302681:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302689:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651119.302698:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788651119.302987:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.302995:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303001:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303006:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.303015:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303023:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303035:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651119.303039:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.303044:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303050:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303064:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303070:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303075:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303080:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.303082:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303088:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303094:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79000) 00010000:00010000:1.0:1788651119.303095:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.303105:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303164:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797784a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303206:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797783c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 22 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303221:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 21 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.303228:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.303231:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651119.303233:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41671c00, rc 0) 00000100:00100000:1.0:1788651119.303294:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10454:x1875536389384704:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1074us (1412us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788651119.303302:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:2.0:1788651119.315455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.315570:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389384832 00000100:00100000:1.0:1788651119.315580:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389384832 00000100:00100000:1.0:1788651119.315682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:1.0:1788651119.315694:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10454:x1875536389384832:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1788651119.315781:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315799:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315811:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315857:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315871:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315877:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315892:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.315897:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315905:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315917:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.315920:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651119.315924:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.315930:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba88797785f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.316011:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10454:x1875536389384832:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 319us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651119.316019:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:0.0:1788651119.326538:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651119.326640:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389385088 00000100:00100000:2.0:1788651119.326651:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389385088 00000100:00100000:2.0:1788651119.326718:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1788651119.326738:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10454:x1875536389385088:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651119.326996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:10454:x1875536389385088:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 266us (744us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788651119.327018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1788651119.381698:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.381804:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389385344 00000100:00100000:3.0:1788651119.381814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389385344 00000100:00100000:3.0:1788651119.381868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:3.0:1788651119.381877:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:9983:x1875536389385344:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651119.382794:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651119.382820:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977866 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c151 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.382926:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.382941:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.382966:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.383002:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.383015:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 23 pid: 5871 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651119.383029:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d516300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408278656:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651119.383205:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651119.395001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651119.395220:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389385472 00000100:00100000:2.0:1788651119.395230:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389385472 00010000:00010000:2.0:1788651119.395272:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 24 pid: 5871 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651119.395363:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:2.0:1788651119.395374:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:2356:x1875536389385472:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651119.395389:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651119.395396:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 24 pid: 5871 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.395409:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 24 pid: 5871 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.395429:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:2.0:1788651119.395435:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.395444:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.395451:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.395471:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651119.395531:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:2356:x1875536389385472:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 158us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651119.395552:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00010000:00010000:1.0:1788651119.396682:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba887977851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c14a expref: 23 pid: 5871 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.396719:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d516300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408278656:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651119.396739:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.396749:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.396755:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651119.396772:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788651119.397559:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977866 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.397576:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.397853:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.397857:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651119.397860:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d600, rc 0) 00000100:00100000:1.0:1788651119.397961:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:9983:x1875536389385344:12345-192.168.203.21@tcp:101:bash.0 Request processed in 16083us (16271us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788651119.397969:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:3.0:1788651119.405207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.405663:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389385728 00000100:00100000:1.0:1788651119.405734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389385728 00000100:00100000:1.0:1788651119.405851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 89 00000100:00100000:1.0:1788651119.405864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:9983:x1875536389385728:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:1.0:1788651119.406167:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.406186:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.406197:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651119.406247:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788651119.406272:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ca4868e reply state 00000000be4a8909 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.406281:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788651119.406329:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788651119.406737:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:9983:x1875536389385728:12345-192.168.203.21@tcp:36:bash.0 Request processed in 874us (1537us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788651119.406746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 89 00000020:00080000:1.0:1788651119.406752:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788651119.408152:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.408164:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.408169:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.408173:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.408177:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.408242:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.408254:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.408257:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.408260:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.408265:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671c00/0x84a2fba88797787b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651119.409144:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.409179:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389385856 00000100:00100000:1.0:1788651119.409188:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389385856 00000100:00100000:1.0:1788651119.409564:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:1.0:1788651119.409576:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:9983:x1875536389385856:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1788651119.409597:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651119.409616:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba887977882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c158 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.409670:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba887977882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c158 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.409684:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba887977882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c158 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.409702:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.409705:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651119.409708:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670e00, rc 0) 00000100:00100000:1.0:1788651119.409777:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:9983:x1875536389385856:12345-192.168.203.21@tcp:101:bash.0 Request processed in 202us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651119.409785:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:2.0:1788651119.415996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.416086:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389385984 00000100:00100000:1.0:1788651119.416096:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389385984 00000100:00100000:1.0:1788651119.416183:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1788651119.416194:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:9983:x1875536389385984:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1788651119.416217:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651119.416238:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c15f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651119.416264:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ca66e, atime: 0x6a9ca66c, ctime: 0x6a9ca66e, blocks: 0xb 00010000:00010000:1.0:1788651119.416284:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1788651119.416289:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651119.416296:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.416313:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.416325:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41671c00, rc 0) 00000100:00100000:1.0:1788651119.416476:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:9983:x1875536389385984:12345-192.168.203.21@tcp:101:bash.0 Request processed in 283us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651119.416482:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:0.0:1788651119.419519:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.419765:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389386112 00000100:00100000:3.0:1788651119.419775:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389386112 00002000:00010000:3.0:1788651119.419812:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788651119.419817:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be75802300 with x1875536389386112 ext(0->18446744073709551615) 00002000:00010000:3.0:1788651119.419828:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be75802300. 00000100:00100000:3.0:1788651119.419857:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:3.0:1788651119.419867:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389386112:12345-192.168.203.21@tcp:10:bash.0 00002000:00010000:3.0:1788651119.420214:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788651119.420218:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788651118 -> 1788651119 00002000:00010000:3.0:1788651119.420220:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788651116 -> 1788651116 00002000:00010000:3.0:1788651119.420222:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788651118 -> 1788651119 00002000:00010000:3.0:1788651119.420238:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788651119.420387:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389386112:12345-192.168.203.21@tcp:10:bash.0 Request processed in 520us (875us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788651119.420395:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00002000:00010000:3.0:1788651119.420400:0:6678:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788651119.420403:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be75802300 with x1875536389386112 ext(0->18446744073709551615) 00002000:00010000:3.0:1788651119.420409:0:6678:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be75802300. 00000100:00100000:3.0:1788651119.473565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.473642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389386240 00000100:00100000:0.0:1788651119.473654:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389386240 00000100:00100000:0.0:1788651119.473828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:0.0:1788651119.473840:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:10468:x1875536389386240:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:0.0:1788651119.473922:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.473939:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.473951:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.473966:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.473991:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.473999:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474278:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474288:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474295:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651119.474346:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474359:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474366:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474372:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474378:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651119.474382:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474389:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474409:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:0.0:1788651119.474412:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651119.474417:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474423:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887977890 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474435:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474441:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474447:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474452:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651119.474455:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474460:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474467:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be44b46400) 00010000:00010000:0.0:1788651119.474469:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651119.474472:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474477:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977897 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474511:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474519:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474525:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474530:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651119.474711:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474719:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474728:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:0.0:1788651119.474730:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651119.474734:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.474740:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba88797789e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651119.474870:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:10468:x1875536389386240:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 1029us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651119.474891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:0.0:1788651119.492357:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7ba79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408278784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651119.492423:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651119.492574:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408278784 00000100:00100000:2.0:1788651119.492582:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408278784 00000100:00100000:2.0:1788651119.492635:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788651119.492645:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875536408278784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651119.492680:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651119.492728:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875536408278784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651119.492735:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788651119.492767:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7ba79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408278784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651119.509998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.510095:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389386496 00000100:00100000:3.0:1788651119.510128:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389386496 00000100:00100000:3.0:1788651119.510187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:3.0:1788651119.510197:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:10471:x1875536389386496:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651119.510217:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651119.510238:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c166 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510310:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510325:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510336:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510350:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510357:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510378:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510656:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879778ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510665:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879778ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510682:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879778ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651119.510700:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788651119.510797:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510805:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510816:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510822:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.510826:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510833:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510846:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651119.510848:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651119.510861:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510867:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba8879778ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510879:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510896:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510901:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510906:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.510909:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510915:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510924:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be51759900) 00010000:00010000:3.0:1788651119.510926:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651119.510929:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510935:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879778b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.510974:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c166 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.511001:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879778ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c166 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.511008:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:3.0:1788651119.511010:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788651119.511013:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ca00, rc 0) 00000100:00100000:3.0:1788651119.511083:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10471:x1875536389386496:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 887us (1094us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788651119.511091:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:2.0:1788651119.516041:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.516141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389386624 00000100:00100000:1.0:1788651119.516163:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389386624 00000100:00100000:1.0:1788651119.516218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:1.0:1788651119.516229:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10471:x1875536389386624:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1788651119.516294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.516311:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.516320:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.516352:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.516366:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 29 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.516381:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408278912:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651119.516471:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be50d52540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651119.520349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.520459:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408278912:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651119.520485:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651119.520557:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389386880 00000100:00100000:3.0:1788651119.520565:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389386880 00000100:00100000:3.0:1788651119.520617:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1788651119.520628:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:5590:x1875536389386880:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788651119.521525:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:5590:x1875536389386880:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 894us (1603us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788651119.521535:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:2.0:1788651119.531002:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.534296:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389387008 00000100:00100000:3.0:1788651119.534311:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389387008 00010000:00010000:3.0:1788651119.534361:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 31 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651119.534460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1788651119.534469:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:2356:x1875536389387008:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651119.534484:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651119.534504:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 31 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.534518:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 31 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.534540:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797786d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c151 expref: 31 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.534557:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:3.0:1788651119.534562:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.534572:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.534581:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.534617:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651119.534693:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:2356:x1875536389387008:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 225us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.534701:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00010000:00010000:1.0:1788651119.534776:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534785:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534824:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534831:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534838:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534844:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.534848:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534855:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534865:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.534867:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651119.534871:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.534876:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.534924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10471:x1875536389386624:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 18697us (18892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651119.534932:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:2.0:1788651119.541200:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.541486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389387264 00000100:00100000:0.0:1788651119.541497:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389387264 00000100:00100000:0.0:1788651119.541553:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1788651119.541562:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:10471:x1875536389387264:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1788651119.541785:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:10471:x1875536389387264:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 223us (601us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788651119.541793:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1788651119.591975:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.592015:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.592048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651119.592148:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389387520 00000100:00100000:2.0:1788651119.592157:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389387520 00000100:00100000:2.0:1788651119.592218:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:2.0:1788651119.592228:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2353:x1875536389387520:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651119.592299:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2353:x1875536389387520:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 72us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651119.592307:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00080000:2.0:1788651119.592329:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651119.592603:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389387776 00000100:00100000:3.0:1788651119.592608:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389387776 00000100:00100000:3.0:1788651119.592654:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:3.0:1788651119.592662:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389387776:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651119.592697:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2353:x1875536389387776:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 36us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.592719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:0.0:1788651119.592852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.593351:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389387648 00000100:00100000:3.0:1788651119.593357:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389387648 00000100:00100000:3.0:1788651119.593391:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:3.0:1788651119.593398:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2353:x1875536389387648:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651119.593433:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2353:x1875536389387648:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 36us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.593439:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00080000:2.0:1788651119.594410:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651119.594673:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389387392 00000100:00100000:1.0:1788651119.594682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389387392 00000100:00100000:1.0:1788651119.594775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 279 00000100:00100000:1.0:1788651119.594798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389387392:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651119.594864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2353:x1875536389387392:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651119.594871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 279 00000100:00100000:3.0:1788651119.675315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.675781:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389388032 00000100:00100000:0.0:1788651119.675791:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389388032 00000100:00100000:0.0:1788651119.675853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:0.0:1788651119.675864:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:10482:x1875536389388032:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:0.0:1788651119.675896:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651119.676024:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879778cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c16d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.676099:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.676252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.676266:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676338:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676349:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676357:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879778e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676623:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879778e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676631:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879778e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651119.676641:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788651119.676730:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676738:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676744:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676761:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.676766:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676774:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676784:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651119.676786:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.676791:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676796:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba8879778d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676808:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676813:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676818:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676823:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.676826:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676832:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676846:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79500) 00010000:00010000:1.0:1788651119.676848:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.676851:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676856:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879778dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676909:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba8879778cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c16d expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676922:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879778e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c16d expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.676929:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:1.0:1788651119.676931:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651119.676933:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670400, rc 0) 00000100:00100000:1.0:1788651119.677059:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10482:x1875536389388032:12345-192.168.203.21@tcp:101:cat.0 Request processed in 1196us (1753us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788651119.677068:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:2.0:1788651119.687262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.687640:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389388288 00000100:00100000:0.0:1788651119.687664:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389388288 00000100:00100000:0.0:1788651119.687731:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:0.0:1788651119.687742:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10482:x1875536389388288:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:0.0:1788651119.687991:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:10482:x1875536389388288:12345-192.168.203.21@tcp:35:cat.0 Request processed in 250us (737us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788651119.688010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:2.0:1788651119.702614:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.702760:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389388544 00000100:00100000:3.0:1788651119.702772:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389388544 00000100:00100000:3.0:1788651119.702839:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:3.0:1788651119.702849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:10483:x1875536389388544:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:3.0:1788651119.702918:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788651119.702944:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879778e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c16d expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.702971:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba8879778ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c166 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.702984:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba887977882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c158 expref: 31 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.702994:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be58f79700) 00010000:00010000:3.0:1788651119.703004:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651119.703026:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703045:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703056:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703072:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703079:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703085:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703358:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703367:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.703375:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651119.703987:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788651119.703997:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323763889251ns, next at 324763886717ns, rc = 0 00010000:00010000:3.0:1788651119.704052:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704062:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704080:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704088:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704094:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704101:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704153:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651119.704173:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704178:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704184:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704189:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.704193:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704199:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704210:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be51759e00) 00010000:00010000:3.0:1788651119.704212:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788651119.704222:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704228:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977900 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704243:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704249:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704253:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704257:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651119.704260:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704265:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704271:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651119.704274:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651119.704277:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.704282:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879778f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651119.704289:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017d3430a reply state 00000000bb18d2c9 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651119.704306:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651119.704385:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:10483:x1875536389388544:12345-192.168.203.21@tcp:36:rm.0 Request processed in 1535us (1778us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788651119.704393:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 95 00010000:00010000:2.0:1788651119.704719:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651119.704726:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.704732:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651119.704735:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.704742:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.704751:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93be51759e00) 00010000:00010000:2.0:1788651119.704753:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788651119.704757:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.704764:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977907 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.704779:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651119.704781:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651119.704783:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651119.706685:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.706702:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.706710:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.706716:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56da00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651119.706720:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.706742:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.706755:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be51759900) 00010000:00010000:2.0:1788651119.706758:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651119.706762:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.706768:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba8879778f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651119.747248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.748473:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389388800 00000100:00100000:1.0:1788651119.748483:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389388800 00000100:00100000:1.0:1788651119.748540:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:1.0:1788651119.748551:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:10489:x1875536389388800:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1788651119.748573:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651119.748593:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797790e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c174 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.748729:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.748743:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.748754:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.748767:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.748774:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.748781:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651119.749485:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788651119.749615:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749624:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749632:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749660:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749676:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749682:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749688:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.749692:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749699:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749710:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651119.749712:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.749717:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749723:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977915 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651119.749736:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a60e562 reply state 00000000a1b88f36 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.749743:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788651119.749766:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797790e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749779:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.749796:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:1.0:1788651119.749798:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651119.749800:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670400, rc 0) 00000100:00100000:1.0:1788651119.750067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:10489:x1875536389388800:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1517us (2827us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788651119.750075:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 96 00010000:00010000:1.0:1788651119.761641:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.761659:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.761668:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.761675:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651119.761680:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.761688:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.761704:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79500) 00010000:00010000:1.0:1788651119.761708:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651119.761712:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.761731:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba88797791c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651119.763553:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.763630:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389388928 00000100:00100000:3.0:1788651119.763639:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389388928 00000100:00100000:3.0:1788651119.763701:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:3.0:1788651119.763718:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2353:x1875536389388928:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651119.763737:0:10263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651119.763756:0:10263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c17b expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651119.763782:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651119.763805:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1788651119.763810:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651119.763819:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 6 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.763838:0:10263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 6 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.763851:0:10263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d600, rc 0) 00000100:00100000:3.0:1788651119.763911:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389388928:12345-192.168.203.21@tcp:101:bash.0 Request processed in 201us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.763918:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:3.0:1788651119.770718:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651119.770820:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389389056 00000100:00100000:2.0:1788651119.770830:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389389056 00000100:00100000:2.0:1788651119.770901:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:2.0:1788651119.770912:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:10489:x1875536389389056:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651119.770929:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651119.770949:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c182 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.770980:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.770989:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651119.770993:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651119.770999:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.771077:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651119.771093:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651119.771139:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d76d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6675:1875536408279040:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651119.771239:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44b5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651119.774197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.774313:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d76d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6675:1875536408279040:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651119.774343:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.774364:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:3.0:1788651119.774419:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:10489:x1875536389389056:12345-192.168.203.21@tcp:101:bash.0 Request processed in 3509us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.774427:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:0.0:1788651119.775321:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389389184 00000100:00100000:0.0:1788651119.775329:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389389184 00010000:00010000:0.0:1788651119.775367:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651119.775442:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:0.0:1788651119.775452:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389389184:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651119.775467:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651119.775488:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.775502:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.775524:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134ddddc/0x84a2fba887977931 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c17b expref: 7 pid: 10263 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.775537:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651119.775541:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651119.775549:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.775573:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.775607:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651119.775621:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1875536408279168:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651119.775854:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651119.780393:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.780562:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75801500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1875536408279168:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651119.780588:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651119.780648:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389389184:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 5197us (6458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651119.780671:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1788651119.781649:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389389440 00000100:00100000:3.0:1788651119.781659:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389389440 00000100:00100000:3.0:1788651119.781752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:3.0:1788651119.781763:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:10489:x1875536389389440:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:3.0:1788651119.782101:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:10489:x1875536389389440:12345-192.168.203.21@tcp:35:bash.0 Request processed in 340us (1716us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788651119.782123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:2.0:1788651119.935763:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.935941:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389389568 00000100:00100000:3.0:1788651119.935959:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389389568 00000100:00100000:3.0:1788651119.936048:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:3.0:1788651119.936060:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:10505:x1875536389389568:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651119.936091:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651119.936168:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba88797793f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c189 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.936262:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.936300:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.936315:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651119.936359:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788651119.936363:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651119.936399:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.936428:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba88797793f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c189 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.936449:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c189 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.936458:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651119.936461:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651119.936466:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ca00, rc 0) 00000100:00100000:3.0:1788651119.936552:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10505:x1875536389389568:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 494us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651119.936560:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 97 00010000:00010000:0.0:1788651119.940573:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651119.942758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.942939:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389389824 00000100:00100000:1.0:1788651119.942955:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389389824 00000100:00100000:1.0:1788651119.943035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:1.0:1788651119.943046:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:10505:x1875536389389824:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651119.943072:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651119.943098:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797794d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c190 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.943277:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.943293:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.943308:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651119.943322:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788651119.943499:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba88797794d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c190 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.943522:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c190 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.943531:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:1.0:1788651119.943534:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651119.943539:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41671600, rc 0) 00000100:00100000:1.0:1788651119.943618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+37:10505:x1875536389389824:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 573us (868us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788651119.943644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:2.0:1788651119.958647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651119.958934:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651119.959066:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390208 00000100:00100000:0.0:1788651119.959079:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390208 00000100:00100000:0.0:1788651119.959178:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1788651119.959201:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+37:2354:x1875536389390208:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651119.959222:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651119.959255:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba887977954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c190 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651119.959283:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:0.0:1788651119.959290:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651119.959390:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:2354:x1875536389390208:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 195us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651119.959399:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1788651119.966907:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390080 00000100:00100000:3.0:1788651119.966929:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390080 00000100:00100000:3.0:1788651119.967017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:3.0:1788651119.967030:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:10505:x1875536389390080:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651119.967061:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651119.967896:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c197 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.968044:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977969 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.968063:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.968078:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651119.968094:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788651119.968409:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c197 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.968431:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c197 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.968441:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:3.0:1788651119.968444:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788651119.968449:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c200, rc 0) 00000100:00100000:3.0:1788651119.968544:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:10505:x1875536389390080:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1516us (9911us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788651119.968554:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:2.0:1788651119.976012:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651119.976197:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390336 00000100:00100000:1.0:1788651119.976212:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390336 00000100:00100000:1.0:1788651119.976280:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:1.0:1788651119.976293:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389390336:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:1.0:1788651119.976357:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.976385:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.976395:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788651119.976399:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651119.976404:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.976455:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 6 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.976471:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 6 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651119.976489:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408279296:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651119.976606:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be50d52480 going to sleep for 11 seconds 00000100:00100000:1.0:1788651119.982344:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408279296:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651119.982411:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651119.984140:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651119.984580:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390464 00000100:00100000:3.0:1788651119.984593:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390464 00002000:00100000:3.0:1788651119.984657:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93be6d76fb80 x1875536389390464/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:260/0 lens 504/0 e 0 to 0 dl 1788651130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651119.984733:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be6d76fb80 with x1875536389390464 ext(0->8) 00010000:00010000:3.0:1788651119.984824:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 7 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651119.984844:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 7 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651119.984852:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be6d76fb80 00000100:00100000:3.0:1788651119.984938:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:3.0:1788651119.984949:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389390464:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:1.0:1788651119.996540:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2355:x1875536389390464:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 11577us (12422us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788651119.996563:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00002000:00100000:1.0:1788651119.996577:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93be6d76fb80 x1875536389390464/t4294967302(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:260/0 lens 504/448 e 0 to 0 dl 1788651130 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651119.996589:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be6d76fb80 with x1875536389390464 ext(0->8) 00010000:00010000:1.0:1788651119.996601:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 9 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651119.996626:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 9 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651119.996634:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be6d76fb80 00000100:00100000:2.0:1788651120.001270:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.001876:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390592 00000100:00100000:3.0:1788651120.001906:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390592 00010000:00010000:3.0:1788651120.001962:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 9 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651120.002072:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1788651120.002085:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2355:x1875536389390592:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651120.002152:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788651120.002180:0:11151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788651120.002183:0:11151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788651120 00002000:00010000:3.0:1788651120.002186:0:11151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788651120 00002000:00010000:3.0:1788651120.002188:0:11151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788651120 00010000:00010000:3.0:1788651120.002195:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 9 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.002214:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 9 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.002270:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c182 expref: 9 pid: 6675 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.002294:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651120.002299:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651120.002307:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.002320:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.002352:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651120.002445:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389390592:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 361us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.002452:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00010000:00010000:1.0:1788651120.002526:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002538:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002571:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002580:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002598:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002605:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651120.002610:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002621:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002634:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.002642:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000014c2be5/0x84a2fba887977977 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.004717:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389390336:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 28413us (28706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.004887:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:2.0:1788651120.011576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651120.012087:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390848 00000100:00100000:0.0:1788651120.012102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390848 00000100:00100000:0.0:1788651120.012302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:0.0:1788651120.012316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:10505:x1875536389390848:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:0.0:1788651120.012402:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c197 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651120.013036:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788651120.013082:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788651120.013470:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788651120.013537:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.013557:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.013568:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.013609:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.013625:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 42 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651120.013642:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75800000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875536408279424:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651120.015067:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651120.023191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.023297:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389390976 00000100:00100000:1.0:1788651120.023309:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389390976 00010000:00010000:1.0:1788651120.023362:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 43 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.023412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:1.0:1788651120.023443:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:2355:x1875536389390976:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651120.023463:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651120.023471:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 43 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.023487:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 43 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.023516:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:1.0:1788651120.023523:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.023534:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.023543:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.023565:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651120.023639:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:2355:x1875536389390976:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 197us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.023646:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00010000:00010000:0.0:1788651120.025764:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba887977923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c174 expref: 42 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651120.025797:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75800000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875536408279424:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651120.025839:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.025851:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.025857:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651120.026053:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788651120.026366:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788651120.026504:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75800000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408279552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788651120.026582:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651120.026626:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651120.026989:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408279552 00000100:00100000:3.0:1788651120.026998:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408279552 00000100:00100000:3.0:1788651120.027082:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788651120.027095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1875536408279552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788651120.027234:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1875536408279552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.027242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788651120.027313:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651120.027972:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75800000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408279552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788651120.028636:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788651120.028768:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408279680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788651120.028845:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651120.028892:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be50d52240 going to sleep for 11 seconds 00000100:00100000:3.0:1788651120.029281:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408279680 00000100:00100000:3.0:1788651120.029291:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408279680 00000100:00100000:3.0:1788651120.029340:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788651120.029351:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1875536408279680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788651120.029609:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5844:x1875536408279680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 259us (763us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788651120.029619:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651120.030254:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408279680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788651120.030354:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788651120.030414:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.030427:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.030436:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.030443:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.030449:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.030459:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.030479:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:1.0:1788651120.030483:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788651120.030489:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.030496:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba88797797e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651120.031038:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788651120.033354:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788651120.033384:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324093275610ns, next at 325093270205ns, rc = 0 00000001:00080000:1.0:1788651120.033405:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788651120.033488:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:1.0:1788651120.033493:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788651120.033526:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977969 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c197 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.035173:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:10505:x1875536389390848:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 22847us (23596us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788651120.035191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000020:00080000:1.0:1788651120.035200:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788651120.043397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.043482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389391104 00000100:00100000:1.0:1788651120.043496:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389391104 00000100:00100000:1.0:1788651120.043561:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:1.0:1788651120.043574:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:10505:x1875536389391104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651120.043604:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651120.043636:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba887977985 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c19e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.043760:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba887977985 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c19e expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.043779:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba887977985 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c19e expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.043805:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.043809:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651120.043813:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41671400, rc 0) 00000100:00100000:1.0:1788651120.043906:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:10505:x1875536389391104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 326us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.043915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:2.0:1788651120.050619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.051567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389391360 00000100:00100000:3.0:1788651120.051585:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389391360 00000100:00100000:3.0:1788651120.051675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:3.0:1788651120.051690:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:10505:x1875536389391360:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1788651120.052468:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10505:x1875536389391360:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 779us (1861us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788651120.052477:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:2.0:1788651120.171772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.171901:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389391488 00000100:00100000:1.0:1788651120.171931:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389391488 00000100:00100000:1.0:1788651120.172006:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:1.0:1788651120.172019:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10515:x1875536389391488:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:1.0:1788651120.172158:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172180:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172194:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172215:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172222:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172230:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172351:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172359:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172367:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651120.172421:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172450:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172457:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172464:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172470:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.172475:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172484:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172498:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651120.172501:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651120.172507:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172514:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba88797798c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172531:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172538:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172544:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172555:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.172559:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172565:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172574:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79c00) 00010000:00010000:1.0:1788651120.172576:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651120.172579:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172586:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba887977993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172603:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172611:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172616:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172622:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41671600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.172625:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172631:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172650:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.172653:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651120.172656:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.172662:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba88797799a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.172761:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10515:x1875536389391488:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 743us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.172770:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:2.0:1788651120.241102:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.241239:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389391744 00000100:00100000:1.0:1788651120.241257:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389391744 00000100:00100000:1.0:1788651120.241348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 102 00000100:00100000:1.0:1788651120.241362:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:10518:x1875536389391744:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651120.241570:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651120.241602:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879779a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241706:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241725:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241752:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241771:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241798:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241807:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241974:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241984:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.241992:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651120.242003:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788651120.242182:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242191:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242199:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242205:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.242211:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242219:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242245:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651120.242248:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651120.242254:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242261:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670600/0x84a2fba8879779a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242280:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242287:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242293:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242299:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be41670400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.242302:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242308:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242316:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be58f79c00) 00010000:00010000:1.0:1788651120.242319:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651120.242322:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242327:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670400/0x84a2fba8879779af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242400:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671600/0x84a2fba8879779a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242419:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.242428:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.242430:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651120.242433:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be41670e00, rc 0) 00000100:00100000:1.0:1788651120.242532:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:10518:x1875536389391744:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1172us (1438us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788651120.242542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 102 00000100:00100000:2.0:1788651120.245413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.245970:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389391872 00000100:00100000:1.0:1788651120.245981:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389391872 00000100:00100000:1.0:1788651120.246046:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:1.0:1788651120.246058:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:10518:x1875536389391872:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1788651120.246178:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246202:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246215:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246246:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246266:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246274:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246281:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651120.246286:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246300:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246314:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.246317:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651120.246323:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.246329:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879779c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.246407:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:10518:x1875536389391872:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 351us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.246415:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:2.0:1788651120.250432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.250550:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389392128 00000100:00100000:1.0:1788651120.250559:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389392128 00000100:00100000:1.0:1788651120.250679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:1.0:1788651120.250690:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:10518:x1875536389392128:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651120.250970:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10518:x1875536389392128:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 280us (545us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788651120.250994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1788651120.325814:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.336123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389392384 00000100:00100000:3.0:1788651120.336138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389392384 00000100:00100000:3.0:1788651120.336222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:3.0:1788651120.336234:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10528:x1875536389392384:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651120.336259:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651120.336262:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788651120.336293:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c189 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.336316:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651120.336322:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651120.336336:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba8879779cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1ac expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.336459:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.336490:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.336498:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.336536:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.336549:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 50 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651120.336562:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408279808:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651120.336669:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67900 going to sleep for 11 seconds 00000100:00100000:3.0:1788651120.341827:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408279808:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651120.341860:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651120.342423:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651120.342650:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389392512 00000100:00100000:0.0:1788651120.342658:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389392512 00010000:00010000:0.0:1788651120.342696:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 51 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651120.342734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1788651120.342753:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:2356:x1875536389392512:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651120.342769:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651120.342775:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 51 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.342805:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 51 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.342827:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670e00/0x84a2fba8879779b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1a5 expref: 51 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.342845:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:0.0:1788651120.342850:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.342859:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.342865:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.342902:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651120.342953:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:2356:x1875536389392512:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 210us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651120.342961:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00010000:00010000:3.0:1788651120.342991:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.342999:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651120.343017:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788651120.343187:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba8879779cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.343227:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.343237:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651120.343240:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788651120.343242:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d000, rc 0) 00000100:00100000:0.0:1788651120.343693:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10528:x1875536389392384:12345-192.168.203.21@tcp:101:bash.0 Request processed in 7459us (17885us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788651120.343700:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:2.0:1788651120.351069:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.351320:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389392768 00000100:00100000:1.0:1788651120.351330:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389392768 00000100:00100000:1.0:1788651120.351385:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:1.0:1788651120.351395:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:10528:x1875536389392768:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:1.0:1788651120.351651:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.351682:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.351693:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651120.351744:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788651120.351769:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049fdf48a reply state 0000000092f9324d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.351777:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651120.351866:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10528:x1875536389392768:12345-192.168.203.21@tcp:36:bash.0 Request processed in 472us (805us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788651120.351873:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 105 00000020:00080000:1.0:1788651120.351887:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788651120.355813:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651120.355831:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651120.355839:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651120.355846:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651120.355851:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651120.355859:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651120.355887:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:2.0:1788651120.355891:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651120.355895:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651120.355902:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba8879779e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651120.358100:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.362464:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389392896 00000100:00100000:1.0:1788651120.362477:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389392896 00000100:00100000:1.0:1788651120.362540:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:1.0:1788651120.362550:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10528:x1875536389392896:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1788651120.362571:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651120.362603:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879779e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.362687:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.362701:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.362710:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.362742:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.362755:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 53 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.362767:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408279936:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651120.362847:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651120.369302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.369615:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408279936:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651120.369641:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651120.373098:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389393024 00000100:00100000:0.0:1788651120.373143:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389393024 00010000:00010000:0.0:1788651120.373190:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 54 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651120.373253:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:0.0:1788651120.373263:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:2355:x1875536389393024:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651120.373279:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651120.373294:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 54 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.373308:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 54 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.373330:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba8879779d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ac expref: 54 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.373346:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:0.0:1788651120.373352:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.373361:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.373368:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.373400:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651120.373458:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:2355:x1875536389393024:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 195us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651120.373465:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00010000:00010000:1.0:1788651120.373470:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.373478:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651120.373537:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788651120.373542:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651120.373562:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.373592:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879779e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.373608:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.373615:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.373618:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651120.373620:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651120.373648:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10528:x1875536389392896:12345-192.168.203.21@tcp:101:bash.0 Request processed in 11098us (15556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.373654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:2.0:1788651120.381269:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.381334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389393280 00000100:00100000:3.0:1788651120.381343:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389393280 00000100:00100000:3.0:1788651120.381402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:3.0:1788651120.381413:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:10528:x1875536389393280:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:3.0:1788651120.381634:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10528:x1875536389393280:12345-192.168.203.21@tcp:35:bash.0 Request processed in 222us (374us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788651120.381641:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1788651120.475910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.476752:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389393408 00000100:00100000:1.0:1788651120.476768:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389393408 00000100:00100000:1.0:1788651120.476843:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:1.0:1788651120.476855:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:10534:x1875536389393408:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651120.476888:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651120.476918:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879779f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1ba expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.476981:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879779fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.477012:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879779fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.477023:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879779fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651120.477057:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788651120.477060:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651120.477078:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879779fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.477101:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba8879779f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ba expref: 55 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.477162:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879779fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ba expref: 54 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.477171:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651120.477174:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651120.477177:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9ca00, rc 0) 00000100:00100000:1.0:1788651120.477240:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10534:x1875536389393408:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 387us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.477247:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:2.0:1788651120.482186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651120.482293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389393536 00000100:00100000:0.0:1788651120.482324:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389393536 00000100:00100000:0.0:1788651120.482405:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:0.0:1788651120.482417:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10534:x1875536389393536:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651120.482444:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651120.482471:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977a03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1c1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482555:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482572:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482586:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482602:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482610:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482618:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482744:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482754:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.482761:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651120.482825:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788651120.482831:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651120.482855:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483057:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483068:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483075:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483083:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483089:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651120.483096:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483104:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483166:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:0.0:1788651120.483169:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651120.483175:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483182:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483212:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483218:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483224:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483229:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651120.483232:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483239:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483247:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be44b46400) 00010000:00010000:0.0:1788651120.483250:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651120.483252:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483258:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977a11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483299:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977a03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483314:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.483335:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:0.0:1788651120.483338:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651120.483340:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861200, rc 0) 00000100:00100000:0.0:1788651120.483419:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10534:x1875536389393536:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1003us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651120.483427:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:2.0:1788651120.494590:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651120.494649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.494750:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389393792 00000100:00100000:3.0:1788651120.494764:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389393792 00000100:00100000:1.0:1788651120.495156:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389393920 00000100:00100000:1.0:1788651120.495163:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389393920 00000100:00100000:1.0:1788651120.495339:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:1.0:1788651120.495352:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10534:x1875536389393920:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651120.495379:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651120.495421:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977a1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1c8 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495569:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495588:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495598:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495608:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495650:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495665:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 57 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.495680:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408280064:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651120.495812:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.495822:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 57 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.495831:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408280192:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651120.495874:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fec00 going to sleep for 11 seconds 00010000:00010000:3.0:1788651120.495988:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 57 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651120.496021:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:3.0:1788651120.496031:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:2354:x1875536389393792:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651120.496044:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651120.496050:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 57 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.496064:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 57 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.496093:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651120.496097:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.496105:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.496131:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651120.496162:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:2354:x1875536389393792:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 134us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.496170:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:2.0:1788651120.503042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.503434:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389394048 00000100:00100000:3.0:1788651120.503446:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389394048 00010000:00010000:3.0:1788651120.503497:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 57 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651120.503552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:3.0:1788651120.503564:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:2356:x1875536389394048:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651120.503581:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651120.503589:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 57 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.503614:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 57 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.503649:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651120.503656:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.503694:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.503703:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.503727:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651120.503799:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:2356:x1875536389394048:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 236us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.503821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00010000:00010000:1.0:1788651120.505450:0:5871:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.21@tcp) returned -22 from blocking AST (req@000000009b9a526f x1875536408280064) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 56 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.505476:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977a18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c1 expref: 56 pid: 5843 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.505497:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408280064:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651120.505516:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879779ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1b3 expref: 55 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651120.505530:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408280192:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651120.505556:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.505566:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.505577:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.505591:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651120.505630:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788651120.505845:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977a1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 56 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.505872:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 55 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.505907:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651120.505910:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651120.505913:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c400, rc 0) 00000100:00100000:1.0:1788651120.506001:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10534:x1875536389393920:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 10650us (11349us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788651120.506011:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:2.0:1788651120.518803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.523161:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389394304 00000100:00100000:3.0:1788651120.523199:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389394304 00000100:00100000:3.0:1788651120.523306:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1788651120.523326:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10534:x1875536389394304:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:3.0:1788651120.523346:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651120.523375:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41671400/0x84a2fba887977985 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c19e expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.523402:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651120.523408:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651120.523498:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10534:x1875536389394304:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 181us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.523505:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1788651120.528872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651120.529499:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389394432 00000100:00100000:0.0:1788651120.529514:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389394432 00000100:00100000:0.0:1788651120.529598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:0.0:1788651120.529626:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10534:x1875536389394432:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:0.0:1788651120.529780:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.529801:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.529816:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651120.530088:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788651120.533510:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10534:x1875536389394432:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 3878us (4637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651120.533526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 110 00000100:00100000:0.0:1788651120.538610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.538919:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389394560 00000100:00100000:3.0:1788651120.538933:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389394560 00000100:00100000:3.0:1788651120.539027:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:3.0:1788651120.539040:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:10534:x1875536389394560:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651120.539101:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651120.539169:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1cf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.539251:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.539265:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.539289:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.539305:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.539332:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651120.539336:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651120.539341:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.539349:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56dc00, rc 0) 00000100:00100000:3.0:1788651120.539914:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10534:x1875536389394560:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 873us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.539924:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 111 00010000:00010000:2.0:1788651120.965305:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788651120.969152:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651120.969166:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651120.969220:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788651120.969232:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651120.972652:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408280320:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788651120.973147:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651120.977737:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408280320:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788651120.979241:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651120.979337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389394688 00000100:00100000:0.0:1788651120.979350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389394688 00000100:00100000:0.0:1788651120.979437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:0.0:1788651120.979469:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10536:x1875536389394688:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788651120.979508:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788651120.979751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10536:x1875536389394688:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 285us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651120.979759:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:0.0:1788651120.983359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651120.983421:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389394816 00000100:00100000:3.0:1788651120.983433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389394816 00000100:00100000:3.0:1788651120.983500:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:3.0:1788651120.983511:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10536:x1875536389394816:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788651120.983600:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.983622:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.983636:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985612:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985640:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985654:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985769:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985780:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985808:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651120.985866:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788651120.985870:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651120.985898:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985913:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985920:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985927:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985933:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651120.985939:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985947:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985962:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:3.0:1788651120.985965:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651120.985971:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.985977:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977a42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986006:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986013:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986019:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986024:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651120.986027:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986033:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986040:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93be51759000) 00010000:00010000:3.0:1788651120.986043:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651120.986046:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986051:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986065:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986071:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986076:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986087:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651120.986090:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986096:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986104:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651120.986243:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651120.986249:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651120.986256:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651120.986379:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10536:x1875536389394816:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 2863us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651120.986390:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:2.0:1788651120.989530:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651120.989662:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389395072 00000100:00100000:0.0:1788651120.989675:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389395072 00000100:00100000:0.0:1788651120.989740:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:0.0:1788651120.989754:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:10536:x1875536389395072:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651120.989779:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651120.989804:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977a57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990394:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990407:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651120.990420:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788651120.990558:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990566:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990598:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990605:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651120.990610:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990620:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990633:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:0.0:1788651120.990637:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788651120.990643:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990650:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990700:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977a57 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1d6 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990711:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:0.0:1788651120.990714:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651120.990718:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977a57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1d6 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651120.990728:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860000, rc 0) 00000100:00100000:0.0:1788651120.991128:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10536:x1875536389395072:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1354us (1589us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788651120.991149:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:2.0:1788651120.994542:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.994612:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389395200 00000100:00100000:1.0:1788651120.994625:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389395200 00000100:00100000:1.0:1788651120.994691:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:1.0:1788651120.994705:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10536:x1875536389395200:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788651120.994773:0:5871:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788651120.995010:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10536:x1875536389395200:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 308us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651120.995018:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:2.0:1788651120.997697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651120.997786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389395456 00000100:00100000:1.0:1788651120.997795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389395456 00000100:00100000:1.0:1788651120.997966:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:1.0:1788651120.997979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10536:x1875536389395456:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651120.998005:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651120.998009:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788651120.998048:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879779fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1ba expref: 56 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651120.998075:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:1.0:1788651120.998101:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651120.999014:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977a6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1dd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651121.000633:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788651121.002631:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.002660:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.002677:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.002776:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977a6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1dd expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.005428:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1dd expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.005452:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:1.0:1788651121.005456:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651121.005461:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651121.005568:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10536:x1875536389395456:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 7589us (7880us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788651121.005579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:2.0:1788651121.013812:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.013982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389395712 00000100:00100000:3.0:1788651121.013993:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389395712 00000100:00100000:3.0:1788651121.014070:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:3.0:1788651121.014081:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10536:x1875536389395712:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651121.014192:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651121.014227:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1dd expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014254:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be58f79c00) 00010000:00010000:3.0:1788651121.014266:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651121.014310:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014327:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014339:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014355:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014362:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014369:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014461:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014468:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014475:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014482:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651121.014486:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014494:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014512:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651121.014515:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651121.014519:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014526:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977a81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014535:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014540:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014546:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014551:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651121.014555:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014560:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014567:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x93fd1004 (ffff93be51759000) 00010000:00010000:3.0:1788651121.014569:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651121.014571:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.014577:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x93fd1004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.014668:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10536:x1875536389395712:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 588us (883us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651121.014676:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00080000:2.0:1788651121.017968:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651121.025137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651121.025227:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389395840 00000100:00100000:0.0:1788651121.025239:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389395840 00000100:00100000:0.0:1788651121.025310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:0.0:1788651121.025323:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:10536:x1875536389395840:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651121.025346:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651121.025387:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.025444:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.025461:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.025474:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.025614:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.025637:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.025647:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:0.0:1788651121.025650:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651121.025654:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861c00, rc 0) 00000100:00100000:0.0:1788651121.025772:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10536:x1875536389395840:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 451us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.025788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:0.0:1788651121.034520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.034628:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389396096 00000100:00100000:3.0:1788651121.034641:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389396096 00000100:00100000:3.0:1788651121.034721:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:3.0:1788651121.034733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:10536:x1875536389396096:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651121.035072:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.035094:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.035156:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651121.035489:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788651121.035502:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325095393704ns, next at 326095390314ns, rc = 0 00000004:00010000:3.0:1788651121.035629:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cd97f1f reply state 000000005f8eb08f transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.035640:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651121.035781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:10536:x1875536389396096:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1047us (1275us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788651121.035790:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00010000:00010000:1.0:1788651121.047813:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.047837:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.047867:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.047883:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651121.047889:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.047898:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.047920:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:1.0:1788651121.047924:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788651121.047930:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.047938:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977a9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.049208:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651121.049442:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389396224 00000100:00100000:1.0:1788651121.049454:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389396224 00000100:00100000:1.0:1788651121.049528:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:1.0:1788651121.049539:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:10536:x1875536389396224:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651121.049566:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651121.049593:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1eb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.049670:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.049708:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.049734:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:1.0:1788651121.049738:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651121.049742:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c200, rc 0) 00000100:00100000:1.0:1788651121.049825:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:10536:x1875536389396224:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 287us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651121.049833:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:2.0:1788651121.054216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651121.054896:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389396352 00000100:00100000:0.0:1788651121.054908:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389396352 00000100:00100000:0.0:1788651121.055003:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:0.0:1788651121.055015:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2354:x1875536389396352:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788651121.056440:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651121.059231:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2354:x1875536389396352:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 4203us (5015us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788651121.059248:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1788651121.067549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651121.067787:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389396608 00000100:00100000:1.0:1788651121.067821:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389396608 00000100:00100000:1.0:1788651121.067900:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:1.0:1788651121.067912:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:10536:x1875536389396608:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788651121.079969:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:10536:x1875536389396608:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 12038us (12415us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788651121.079989:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:1.0:1788651121.084560:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.084666:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389396864 00000100:00100000:3.0:1788651121.084696:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389396864 00000100:00100000:3.0:1788651121.084768:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:3.0:1788651121.084780:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:10536:x1875536389396864:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651121.085428:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:10536:x1875536389396864:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 647us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651121.085438:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:2.0:1788651121.089456:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651121.089540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389396992 00000100:00100000:1.0:1788651121.089551:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389396992 00000100:00100000:1.0:1788651121.089620:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:1.0:1788651121.089632:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:10536:x1875536389396992:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651121.089657:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651121.089695:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977aab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.089806:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977ab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.089824:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.089837:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651121.089894:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651121.089920:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.089952:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977aab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f2 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.089973:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f2 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.089983:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:1.0:1788651121.089986:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788651121.089991:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:1.0:1788651121.090070:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:10536:x1875536389396992:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 440us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651121.090077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:2.0:1788651121.093039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.093144:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389397120 00000100:00100000:3.0:1788651121.093157:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389397120 00000100:00100000:3.0:1788651121.093226:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:3.0:1788651121.093239:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2354:x1875536389397120:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651121.093263:0:10263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651121.093292:0:10263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c1f9 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651121.093330:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca671, blocks: 0x1 00010000:00010000:3.0:1788651121.093356:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1788651121.093362:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651121.093374:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 10 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.093394:0:10263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 10 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.093410:0:10263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d000, rc 0) 00000100:00100000:3.0:1788651121.093483:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:2354:x1875536389397120:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 246us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651121.093516:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:0.0:1788651121.100889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.101029:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389397376 00000100:00100000:3.0:1788651121.101042:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389397376 00000100:00100000:3.0:1788651121.101140:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:3.0:1788651121.101153:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:10536:x1875536389397376:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651121.101317:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:10536:x1875536389397376:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 166us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651121.101325:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:2.0:1788651121.105995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.106267:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389397504 00000100:00100000:3.0:1788651121.106277:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389397504 00000100:00100000:3.0:1788651121.106340:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:3.0:1788651121.106351:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:10536:x1875536389397504:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651121.106372:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651121.106395:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c200 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.106434:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 11 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.106444:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651121.106449:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651121.106456:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.106494:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 11 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.106526:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 11 pid: 10263 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.106543:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408280448:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651121.106842:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651121.122567:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651121.122781:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389397632 00000100:00100000:0.0:1788651121.122801:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389397632 00010000:00010000:0.0:1788651121.122855:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 12 pid: 10263 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.122913:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:0.0:1788651121.122925:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:2355:x1875536389397632:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651121.122944:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651121.122978:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 12 pid: 10263 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.122995:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 12 pid: 10263 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.123053:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651121.123058:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651121.123070:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.123082:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.123314:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.123332:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7ba78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875536408280576:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651121.123433:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788651121.124042:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba887977ab9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f9 expref: 12 pid: 10263 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.124064:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d517b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408280448:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651121.124092:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.124245:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ca00, rc 0) 00000100:00100000:3.0:1788651121.124296:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:10536:x1875536389397504:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 17945us (18312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651121.124304:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:2.0:1788651121.135362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.135972:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389397760 00000100:00100000:3.0:1788651121.135984:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389397760 00002000:00100000:3.0:1788651121.136055:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93be42e3c000 x1875536389397760/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:262/0 lens 504/0 e 0 to 0 dl 1788651132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651121.136068:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be42e3c000 with x1875536389397760 ext(0->12) 00002000:00010000:3.0:1788651121.136076:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be42e3c000 00000100:00100000:3.0:1788651121.136155:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1788651121.136191:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:2355:x1875536389397760:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788651121.137095:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2355:x1875536389397760:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 910us (1742us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788651121.137133:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00002000:00100000:3.0:1788651121.137145:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93be42e3c000 x1875536389397760/t4294967308(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:262/0 lens 504/448 e 0 to 0 dl 1788651132 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651121.137155:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be42e3c000 with x1875536389397760 ext(0->12) 00002000:00010000:3.0:1788651121.137160:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be42e3c000 00000100:00100000:0.0:1788651121.139025:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7ba78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875536408280576:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651121.139058:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651121.139198:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:2355:x1875536389397632:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 16274us (16645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.139210:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:1.0:1788651121.142556:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.144362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389397888 00000100:00100000:3.0:1788651121.144382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389397888 00000100:00100000:3.0:1788651121.144465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:3.0:1788651121.144477:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:10536:x1875536389397888:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788651121.226414:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:0.0:1788651121.226460:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be45c73480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788651121.226467:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be6011ae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93bd41086cc0 00000020:00080000:0.0:1788651121.226470:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be6011a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be61639c00 00000020:00080000:3.0:1788651121.226550:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000100:00100000:1.0:1788651121.226628:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:10536:x1875536389397888:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 82145us (84079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651121.226663:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000020:00080000:3.0:1788651121.226795:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000020:00080000:0.0:1788651121.226866:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1788651121.226892:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788651121.226917:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788651121.226939:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be50d52480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788651121.226943:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be7bcc4900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93be50d529c0 00000020:00080000:0.0:1788651121.226947:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be7bcc4400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be7bf03c00 00000004:00080000:0.0:1788651121.226986:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788651121.227012:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788651121.227071:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788651121.227103:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788651121.227187:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408280704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788651121.227214:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408280960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788651121.227221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408280832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788651121.227255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651121.227289:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408280960 00000100:00100000:1.0:1788651121.227355:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651121.227433:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408280704 00000100:00100000:0.0:1788651121.227440:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408280704 00000100:00100000:2.0:1788651121.227484:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651121.227537:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408280960 00000100:00100000:3.0:1788651121.227589:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408280832 00000100:00100000:3.0:1788651121.227593:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408280832 00000100:00100000:3.0:1788651121.227677:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788651121.227688:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875536408280960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788651121.227722:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788651121.227733:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875536408280704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788651121.227753:0:6672:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788651121.227781:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.227807:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.227818:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788651121.227823:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651121.227829:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.227863:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651121.227888:0:10263:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788651121.227893:0:10263:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788651121 00010000:00010000:0.0:1788651121.227895:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 11 pid: 6674 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651121.227905:0:10263:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788651121.227911:0:10263:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788651121 -> 1788651121 00002000:00010000:3.0:1788651121.227917:0:10263:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788651121.227926:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7ba78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6672:1875536408281088:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651121.227974:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875536408280960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (719us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788651121.227983:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788651121.227991:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651121.228005:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651121.228013:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1875536408280832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788651121.228027:0:10263:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788651121.228054:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ca670, atime: 0x6a9ca670, ctime: 0x6a9ca670, blocks: 0x1 00010000:00010000:3.0:1788651121.228061:0:10263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.228071:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1788651121.228075:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651121.228081:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.228097:0:10263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.228140:0:10263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.228150:0:10263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.228187:0:10263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651121.228228:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651121.228238:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788651121.228267:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788651121.228288:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651121.228301:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.228313:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.228335:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.228344:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd6504e/0x84a2fba887977ace lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651121.228361:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be74f96680/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788651121.228369:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408280960:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788651121.228380:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651121.228384:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651121.228387:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651121.228680:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3306:x1875536408280832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 668us (1197us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788651121.228686:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1788651121.228717:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be7fe3df80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788651121.228726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408280832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788651121.232469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651121.232550:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389398016 00000100:00100000:1.0:1788651121.232561:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389398016 00010000:00010000:1.0:1788651121.232613:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 12 pid: 6674 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651121.232664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:1.0:1788651121.232675:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:2356:x1875536389398016:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651121.232693:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651121.232711:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 12 pid: 6674 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.232728:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 12 pid: 6674 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.232754:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7ba78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6672:1875536408281088:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651121.232761:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000052cc97/0x84a2fba887977889 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c15f expref: 12 pid: 6674 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.232788:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.233475:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651121.233499:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651121.233507:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.233520:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.233606:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651121.233691:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:2356:x1875536389398016:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1015us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.233704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00010000:00010000:1.0:1788651121.233763:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.233773:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.233785:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.233794:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.233815:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651121.234461:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651121.234470:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.234485:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860a00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651121.234490:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.234501:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.234517:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.234538:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977ac7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.234560:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651121.234562:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651121.234564:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651121.236640:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875536408280704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8895us (9269us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788651121.236657:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1788651121.236708:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be42e3ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788651121.236853:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408280704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788651121.237075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651121.237242:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389398144 00000100:00100000:2.0:1788651121.237251:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389398144 00000100:00100000:2.0:1788651121.237345:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:2.0:1788651121.237358:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:2356:x1875536389398144:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788651121.271166:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788651121.271196:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788651121.271208:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788651121.272195:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389398144:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 34828us (35110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.272213:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:2.0:1788651121.284650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.285411:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389398400 00000100:00100000:3.0:1788651121.285425:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389398400 00000100:00100000:3.0:1788651121.285500:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:3.0:1788651121.285513:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:10536:x1875536389398400:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651121.285583:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651121.286397:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977ab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1f2 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.286429:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:3.0:1788651121.286436:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651121.286482:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.286500:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.286513:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651121.288607:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fca5f7f9 reply state 0000000044d42a65 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.288884:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651121.289386:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:10536:x1875536389398400:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 3866us (4742us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788651121.289398:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:3.0:1788651121.292270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:2.0:1788651121.292313:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.292329:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.292370:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.292377:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651121.292384:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.292394:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.292417:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:2.0:1788651121.292422:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651121.292425:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389398528 00010000:00010000:2.0:1788651121.292428:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.292437:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389398528 00010000:00010000:2.0:1788651121.292438:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ad5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.292508:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:0.0:1788651121.292521:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389398528:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788651121.292904:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788651121.292909:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788651121 -> 1788651120 00002000:00010000:0.0:1788651121.292911:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788651120 00002000:00010000:0.0:1788651121.292914:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788651121 -> 1788651120 00002000:00010000:0.0:1788651121.292916:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788651121.292994:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389398528:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 475us (739us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788651121.293004:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1788651121.298866:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651121.302072:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389398784 00000100:00100000:2.0:1788651121.302092:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389398784 00000100:00100000:2.0:1788651121.302207:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:2.0:1788651121.302221:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:10536:x1875536389398784:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788651121.302314:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.302339:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.302350:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.302420:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.302436:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 15 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651121.302454:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408281216:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651121.302585:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651121.306991:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408281216:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651121.307036:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651121.313598:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651121.313811:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389398912 00000100:00100000:2.0:1788651121.313822:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389398912 00010000:00010000:2.0:1788651121.313885:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651121.313935:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:2.0:1788651121.313947:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:2356:x1875536389398912:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651121.313965:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651121.313974:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.313989:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.314030:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1e4 expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.314052:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:2.0:1788651121.314077:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.314090:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.314100:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.314180:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651121.314257:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:2356:x1875536389398912:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 300us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651121.314265:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00010000:00010000:1.0:1788651121.315623:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315651:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315699:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315708:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315717:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315732:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651121.315738:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315747:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315766:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:1.0:1788651121.315769:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788651121.315775:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.315782:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977adc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651121.315908:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:10536:x1875536389398784:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 13686us (17053us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788651121.315918:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:2.0:1788651121.323297:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.323435:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389399040 00000100:00100000:3.0:1788651121.323446:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389399040 00000100:00100000:3.0:1788651121.323519:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:3.0:1788651121.323531:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389399040:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788651121.323599:0:10263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.323625:0:10263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.323635:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651121.323640:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651121.323647:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.323691:0:10263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 7 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.323707:0:10263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 7 pid: 6675 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.323749:0:10263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10263:1875536408281344:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651121.323857:0:10263:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67780 going to sleep for 11 seconds 00000100:00100000:2.0:1788651121.339509:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651121.339818:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389399168 00000100:00100000:0.0:1788651121.339849:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389399168 00010000:00010000:0.0:1788651121.339912:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 8 pid: 6675 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.340175:0:10263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10263:1875536408281344:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651121.340206:0:10263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.340295:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:0.0:1788651121.340308:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389399168:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651121.340326:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651121.340360:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 8 pid: 6675 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.340375:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 8 pid: 6675 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.340406:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887977ac0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c200 expref: 8 pid: 6675 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.340427:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651121.340432:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651121.340439:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.340450:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.340484:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651121.340549:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389399168:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 243us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.340568:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00010000:00010000:3.0:1788651121.341017:0:10263:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341030:0:10263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341063:0:10263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341072:0:10263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341081:0:10263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341089:0:10263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651121.341095:0:10263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341138:0:10263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341153:0:10263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.341162:0:10263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134ddddc/0x84a2fba887977ae3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651121.341251:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389399040:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 17713us (17958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651121.341261:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:2.0:1788651121.353868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651121.353987:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389399424 00000100:00100000:1.0:1788651121.353998:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389399424 00000100:00100000:1.0:1788651121.354068:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 127 00000100:00100000:1.0:1788651121.354080:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:10536:x1875536389399424:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788651121.354232:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354267:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354283:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354561:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354574:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354584:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354627:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.354642:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 15 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651121.354679:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408281472:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651121.354773:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651121.363623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.363653:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408281472:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651121.363694:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651121.364138:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389399552 00000100:00100000:2.0:1788651121.364147:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389399552 00010000:00010000:2.0:1788651121.364413:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651121.364474:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:2.0:1788651121.364485:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:2356:x1875536389399552:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651121.364503:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651121.364511:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.364523:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.364567:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977aa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1eb expref: 16 pid: 5843 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.364588:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:2.0:1788651121.364594:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.364605:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.364618:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.364643:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651121.364730:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:2356:x1875536389399552:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 247us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651121.364738:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00010000:00010000:3.0:1788651121.366148:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.366167:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651121.367104:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788651121.367360:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788651121.367409:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788651121.367529:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408281600:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788651121.367641:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651121.367696:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7ba67a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651121.368346:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408281600 00000100:00100000:2.0:1788651121.368357:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408281600 00000100:00100000:2.0:1788651121.368423:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651121.368434:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875536408281600:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788651121.368542:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875536408281600:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651121.368550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651121.370426:0:5871:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788651121.370444:0:5871:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1788651121.370483:0:5871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be74f96680, transno 4294967309 00000004:00080000:1.0:1788651121.370502:0:5871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be42e3ea00, transno 4294967310 00000100:00100000:1.0:1788651121.370512:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408281600:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788651121.374035:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788651121.375047:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408281728:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788651121.376829:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651121.377329:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788651121.377528:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408281728 00000100:00100000:2.0:1788651121.377540:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408281728 00000100:00100000:2.0:1788651121.377608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788651121.377620:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875536408281728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788651121.378007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5871:x1875536408281728:12345-0@lo:1000:mdt00_003.0 Request processed in 388us (1186us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788651121.378015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788651121.379370:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408281728:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788651121.379445:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379667:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379677:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379683:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651121.379688:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379698:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379742:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be44b46400) 00010000:00010000:1.0:1788651121.379746:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651121.379752:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379760:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977af1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379809:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379816:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379822:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379828:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651121.379831:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379837:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379844:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651121.379859:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651121.379868:0:5871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379890:0:5871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379908:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651121.379956:0:5871:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651121.379974:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408281856:192.168.203.21@tcp:105: 00000100:00100000:1.0:1788651121.380098:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be46a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788651121.383936:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408281856:192.168.203.21@tcp:105: 00000100:00100000:1.0:1788651121.384015:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651121.384099:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389399680 00000100:00100000:0.0:1788651121.384138:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389399680 00010000:00010000:3.0:1788651121.384272:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384286:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977a34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384327:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384356:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384372:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.384376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00010000:00010000:3.0:1788651121.384389:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.384395:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10534:x1875536389399680:12345-192.168.203.21@tcp:49:lfs.0 00010000:00010000:3.0:1788651121.384902:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384913:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384920:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651121.384926:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384934:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384970:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651121.384973:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651121.384979:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384985:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977af8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.384998:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.385004:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.385010:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.385015:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651121.385017:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.385022:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.385029:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651121.385032:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651121.385035:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.385040:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651121.385472:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651121.385479:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788651121.385589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:10534:x1875536389399680:12345-192.168.203.21@tcp:49:lfs.0 Request processed in 1194us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.385602:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000040:00080000:3.0:1788651121.385997:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788651121.386008:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651121.390098:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:10536:x1875536389399424:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 35994us (36218us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788651121.390134:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 127 00000020:00080000:2.0:1788651121.390147:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788651121.392555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.392687:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389399936 00000100:00100000:3.0:1788651121.392699:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389399936 00000100:00100000:3.0:1788651121.392770:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:3.0:1788651121.392782:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:10534:x1875536389399936:12345-192.168.203.21@tcp:58:lfs.0 00000040:00080000:3.0:1788651121.393326:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788651121.393436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:10534:x1875536389399936:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 654us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651121.393458:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:1.0:1788651121.395689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.395750:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389400192 00000100:00100000:3.0:1788651121.395762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389400192 00000100:00100000:3.0:1788651121.395827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:3.0:1788651121.395838:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:10536:x1875536389400192:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788651121.396767:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788651121.396915:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788651121.396974:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.396996:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.397011:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.397021:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.397038:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.397046:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651121.397074:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788651121.397235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:10536:x1875536389400192:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 1395us (1555us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788651121.397247:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000020:00080000:3.0:1788651121.397254:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788651121.397351:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651121.397361:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.397370:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651121.397376:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.397386:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.397404:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93be51759000) 00010000:00010000:2.0:1788651121.397408:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788651121.397413:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.397419:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977aff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.397443:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651121.397445:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651121.397447:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651121.423866:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651121.428196:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389400320 00000100:00100000:3.0:1788651121.428216:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389400320 00000100:00100000:3.0:1788651121.428308:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 129 00000100:00100000:3.0:1788651121.428319:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:10538:x1875536389400320:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651121.428565:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651121.428963:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977b06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c207 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.429066:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.429650:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.429670:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.429693:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.429702:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.429709:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.430789:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.430809:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 21 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.430821:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.432004:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 21 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.432034:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 21 pid: 5871 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.432052:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7ba78000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408281984:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651121.432993:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651121.445921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651121.446061:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389400576 00000100:00100000:2.0:1788651121.446084:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389400576 00000100:00100000:2.0:1788651121.446190:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1788651121.446202:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:5591:x1875536389400576:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788651121.446542:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:5591:x1875536389400576:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 340us (636us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788651121.446551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:0.0:1788651121.448382:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7ba78000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408281984:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651121.448422:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651121.451163:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651121.451531:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389400704 00000100:00100000:0.0:1788651121.451543:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389400704 00010000:00010000:0.0:1788651121.451592:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 23 pid: 5871 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.451648:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1788651121.451681:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:2355:x1875536389400704:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651121.451702:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651121.451712:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 23 pid: 5871 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.451730:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 23 pid: 5871 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.451760:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977a26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1c8 expref: 23 pid: 5871 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.451787:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:0.0:1788651121.451793:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.451805:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.451815:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651121.452012:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651121.452340:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.452352:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651121.452411:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788651121.452417:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651121.452442:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651121.452591:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:2355:x1875536389400704:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 909us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651121.452601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00010000:00010000:2.0:1788651121.454036:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454061:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454069:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454349:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454357:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651121.454382:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454392:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454411:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:2.0:1788651121.454414:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651121.454420:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454428:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977b0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454446:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454453:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454928:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454934:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651121.454938:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454945:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.454956:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93be44b46c00) 00010000:00010000:2.0:1788651121.454958:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651121.454971:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.455046:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977b14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.455366:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977b06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c207 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.455388:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c207 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651121.455398:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:2.0:1788651121.455401:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651121.455405:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860c00, rc 0) 00000100:00100000:2.0:1788651121.456007:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10538:x1875536389400320:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 27684us (32152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651121.456018:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 129 00000001:00080000:1.0:1788651121.673480:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1788651121.673497:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788651121.673509:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:3.0:1788651121.995504:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651122.389394:0:12039:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651122.389404:0:12039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651122.389451:0:12039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788651122.389456:0:12039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788651122.439525:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651122.439534:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651122.439584:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788651122.439591:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651122.439711:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408282112:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788651122.439805:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651122.445534:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408282112:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651122.447021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651122.451062:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389400832 00000100:00100000:3.0:1788651122.451077:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389400832 00000100:00100000:3.0:1788651122.451160:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 130 00000100:00100000:3.0:1788651122.451171:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10551:x1875536389400832:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651122.451207:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651122.451318:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10551:x1875536389400832:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 149us (4301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651122.451326:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 130 00000100:00100000:0.0:1788651122.459905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651122.459975:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389401088 00000100:00100000:1.0:1788651122.459985:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389401088 00000100:00100000:1.0:1788651122.460053:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 131 00000100:00100000:1.0:1788651122.460064:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:10551:x1875536389401088:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651122.460084:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651122.460104:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977b22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c20e expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651122.460217:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977b29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651122.460242:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651122.460253:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651122.460264:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788651122.460383:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977b22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c20e expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651122.460401:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977b29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c20e expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651122.460410:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:1.0:1788651122.460412:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651122.460416:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c600, rc 0) 00000100:00100000:1.0:1788651122.460474:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:10551:x1875536389401088:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 412us (578us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788651122.460481:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 131 00000100:00100000:0.0:1788651122.465825:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651122.466193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389401344 00000100:00100000:3.0:1788651122.466204:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389401344 00000100:00100000:3.0:1788651122.466261:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 132 00000100:00100000:3.0:1788651122.466272:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:10551:x1875536389401344:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788651122.466345:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466362:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466373:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466540:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466548:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466555:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466561:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651122.466566:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466572:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466584:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651122.466587:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651122.466606:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651122.466613:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651122.466924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:10551:x1875536389401344:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 652us (1106us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788651122.466934:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 132 00000040:00080000:0.0:1788651122.467072:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651122.467077:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651122.467632:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788651122.467644:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651122.477875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651122.482217:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389401472 00000100:00100000:3.0:1788651122.482232:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389401472 00000100:00100000:0.0:1788651122.482425:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1788651122.482438:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:2356:x1875536389401472:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651122.482455:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651122.482481:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c600/0x84a2fba887977b29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c20e expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651122.482500:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:0.0:1788651122.482505:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651122.482575:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:2356:x1875536389401472:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 140us (4720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651122.482582:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1788651122.484845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651122.484936:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389401728 00000100:00100000:3.0:1788651122.484947:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389401728 00000100:00100000:3.0:1788651122.485002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:3.0:1788651122.485012:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:10551:x1875536389401728:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651122.485266:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:10551:x1875536389401728:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 254us (428us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788651122.485274:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:3.0:1788651122.567919:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408282240:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.567992:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651122.568063:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408282240 00000100:00100000:3.0:1788651122.568072:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408282240 00000100:00100000:3.0:1788651122.568135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788651122.568144:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408282240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.569510:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408282240:12345-0@lo:400:kworker.0 Request processed in 1360us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651122.569523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788651122.569591:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.569632:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651122.569683:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408282368 00000100:00100000:3.0:1788651122.569690:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408282368 00000100:00100000:3.0:1788651122.569724:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788651122.569732:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408282368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.569774:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408282368:12345-0@lo:400:kworker.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651122.569781:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788651122.569818:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.569873:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651122.569882:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408282496:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.569907:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651122.569932:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408282496 00000100:00100000:3.0:1788651122.569936:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408282496 00000100:00100000:3.0:1788651122.569968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788651122.569974:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408282496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.570006:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408282496:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651122.570012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788651122.570027:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651122.570047:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408282496:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.570075:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408282624:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.570100:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651122.570157:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651122.570163:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408282752:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.573340:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651122.573403:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408282752 00000100:00100000:3.0:1788651122.573411:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408282752 00000100:00100000:3.0:1788651122.573467:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788651122.573477:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408282752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.573533:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408282752:12345-0@lo:400:kworker.0 Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651122.573540:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788651122.573560:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651122.573597:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408282752:0@lo:400:kworker.0 00000100:00100000:2.0:1788651122.573840:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408282624 00000100:00100000:2.0:1788651122.573845:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408282624 00000100:00100000:2.0:1788651122.574046:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788651122.574054:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408282624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651122.574098:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408282624:12345-0@lo:400:kworker.0 Request processed in 46us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651122.574104:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788651122.574344:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788651122.574350:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1788651122.574365:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be765e7b80, transno 4294967301 00000004:00080000:2.0:1788651122.574376:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788651122.574386:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be7fe3df80, transno 4294967304 00000100:00100000:2.0:1788651122.574392:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408282624:0@lo:400:kworker.0 00000100:00080000:2.0:1788651122.574622:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651122.575256:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408282880:0@lo:400:kworker.0 00000100:00100000:3.0:1788651122.575303:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651122.578296:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408282880 00000100:00100000:2.0:1788651122.578310:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408282880 00000100:00100000:2.0:1788651122.578365:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788651122.578374:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875536408282880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651122.578463:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875536408282880:12345-0@lo:400:kworker.0 Request processed in 90us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651122.578471:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788651122.578519:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d76c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408282880:0@lo:400:kworker.0 00000100:00100000:1.0:1788651122.582184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408282240:0@lo:400:kworker.0 00010000:00010000:0.0:1788651123.013229:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651123.076427:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408283008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651123.076501:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651123.076699:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283008 00000100:00100000:3.0:1788651123.076708:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283008 00000100:00100000:3.0:1788651123.076768:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788651123.076778:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408283008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651123.076815:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788651123.077207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651123.077439:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408283008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 660us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651123.077448:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651123.077539:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408283008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651124.037825:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788651124.197497:0:12090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651124.197509:0:12090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651124.197558:0:12090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788651124.197566:0:12090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651124.378362:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651124.378462:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389401984 00000100:00100000:3.0:1788651124.378471:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389401984 00000100:00100000:3.0:1788651124.378535:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 133 00000100:00100000:3.0:1788651124.378556:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:10571:x1875536389401984:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651124.378579:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788651124.378581:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788651124.378600:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c215 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.378704:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977b45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.378719:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.378731:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977b45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651124.378741:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788651124.378874:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c215 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.379054:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977b45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c215 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.379062:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651124.379065:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651124.379068:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56da00, rc 0) 00000100:00100000:3.0:1788651124.379158:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:10571:x1875536389401984:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 603us (805us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788651124.379166:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 133 00000100:00100000:1.0:1788651124.382455:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651124.382553:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402112 00000100:00100000:3.0:1788651124.382574:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402112 00000100:00100000:3.0:1788651124.382650:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 134 00000100:00100000:3.0:1788651124.382660:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:10571:x1875536389402112:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1788651124.382728:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382744:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382756:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382782:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382789:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382795:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382800:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651124.382805:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382812:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382824:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651124.382827:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651124.382832:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651124.382859:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651124.382982:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:10571:x1875536389402112:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 323us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651124.382990:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 134 00000100:00100000:2.0:1788651124.510814:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651124.514865:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402240 00000100:00100000:0.0:1788651124.514887:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402240 00000100:00100000:0.0:1788651124.515006:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:0.0:1788651124.515020:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389402240:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:0.0:1788651124.515044:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651124.515076:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794c1561/0x84a2fba887977b5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c21c expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651124.515163:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ca670, atime: 0x6a9ca670, ctime: 0x6a9ca670, blocks: 0xb 00010000:00010000:0.0:1788651124.515191:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1788651124.515196:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651124.515210:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794c1561/0x84a2fba887977b5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c21c expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651124.515261:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000794c1561/0x84a2fba887977b5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c21c expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651124.515276:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860800, rc 0) 00000100:00100000:0.0:1788651124.515357:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389402240:12345-192.168.203.21@tcp:101:cat.0 Request processed in 340us (4557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651124.515364:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00080000:2.0:1788651124.517180:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651124.534183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651124.534910:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402368 00000100:00100000:2.0:1788651124.534925:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402368 00002000:00100000:2.0:1788651124.534996:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93be751caa00 x1875536389402368/t0(0) o3->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:265/0 lens 488/0 e 0 to 0 dl 1788651135 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651124.535009:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be751caa00 with x1875536389402368 ext(0->4095) 00002000:00010000:2.0:1788651124.535016:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be751caa00 00000100:00100000:2.0:1788651124.535059:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:2.0:1788651124.535071:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2353:x1875536389402368:12345-192.168.203.21@tcp:3:cat.0 00000100:00100000:2.0:1788651124.535403:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2353:x1875536389402368:12345-192.168.203.21@tcp:3:cat.0 Request processed in 333us (1235us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788651124.535412:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00100000:2.0:1788651124.535420:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93be751caa00 x1875536389402368/t0(0) o3->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:265/0 lens 488/4536 e 0 to 0 dl 1788651135 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651124.535429:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be751caa00 with x1875536389402368 ext(0->4095) 00002000:00010000:2.0:1788651124.535432:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be751caa00 00000100:00100000:2.0:1788651124.622254:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408283136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651124.622356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651124.622549:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283136 00000100:00100000:1.0:1788651124.622568:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283136 00000100:00100000:1.0:1788651124.622654:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788651124.622678:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408283136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651124.622724:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651124.622808:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408283136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651124.622816:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788651124.622890:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408283136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651124.623973:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651124.701980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651124.702038:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651124.702441:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651124.702473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651124.702480:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402624 00000100:00100000:1.0:1788651124.702491:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402624 00000100:00100000:3.0:1788651124.702493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651124.702526:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402880 00000100:00100000:3.0:1788651124.702530:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402880 00000100:00100000:1.0:1788651124.702541:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403008 00000100:00100000:1.0:1788651124.702543:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403008 00000100:00100000:3.0:1788651124.702553:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402752 00000100:00100000:3.0:1788651124.702555:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402752 00000100:00100000:1.0:1788651124.702570:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:3.0:1788651124.702575:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:1.0:1788651124.702579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:2356:x1875536389402624:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651124.702580:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389402880:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651124.702647:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:2356:x1875536389402624:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 68us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651124.702655:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:1.0:1788651124.702675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:1.0:1788651124.702684:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389403008:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651124.702723:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389402496 00000100:00100000:0.0:1788651124.702738:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389402496 00000100:00100000:2.0:1788651124.702744:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:2.0:1788651124.702761:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389402752:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651124.702816:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 281 00000100:00100000:0.0:1788651124.702829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389402496:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651124.703091:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389402880:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 505us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651124.703091:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389403008:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 404us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651124.703101:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389402752:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 345us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651124.703132:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:1.0:1788651124.703135:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:0.0:1788651124.703177:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389402496:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 349us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651124.703189:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 281 00000100:00080000:3.0:1788651124.703210:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651124.703217:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651124.703689:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00010000:00010000:3.0:1788651125.060378:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651126.084627:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788651126.209715:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1788651126.209734:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93bd411f9cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788651126.209739:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be74e8b500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93bd411f9840 00000020:00080000:0.0:1788651126.209743:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be74e8b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be7c204400 00000001:00080000:0.0:1788651126.209774:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788651126.209810:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788651126.209815:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:0.0:1788651126.209826:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788651126.210033:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788651126.770210:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788651126.770228:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:2.0:1788651127.108386:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651127.684623:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408283392:0@lo:400:kworker.0 00000100:00100000:3.0:1788651127.684818:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408283520:0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.684879:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408283264:0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.685075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651127.685218:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408283776:0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.685248:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651127.685283:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283264 00000100:00100000:0.0:1788651127.685291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283264 00000100:00100000:0.0:1788651127.685371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788651127.685393:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408283264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.685480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408283264:12345-0@lo:400:kworker.0 Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651127.685492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788651127.685570:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283776 00000100:00100000:0.0:1788651127.685573:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283776 00000100:00100000:0.0:1788651127.685605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788651127.685611:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408283776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.685672:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408283776:12345-0@lo:400:kworker.0 Request processed in 56us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651127.685686:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788651127.685720:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651127.685745:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408283264:0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.685758:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408283776:0@lo:400:kworker.0 00000100:00100000:2.0:1788651127.686087:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651127.686160:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408283904:0@lo:400:kworker.0 00000100:00100000:2.0:1788651127.686223:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651127.686254:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408283648:0@lo:400:kworker.0 00000100:00100000:2.0:1788651127.686274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651127.686299:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283904 00000100:00100000:0.0:1788651127.686439:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283392 00000100:00100000:0.0:1788651127.686444:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283392 00000100:00100000:0.0:1788651127.686498:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788651127.686519:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408283392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.686556:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408283392:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651127.686570:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788651127.686595:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408283392:0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.686620:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283648 00000100:00100000:0.0:1788651127.686623:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283648 00000100:00100000:0.0:1788651127.686648:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788651127.686653:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408283648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651127.686683:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408283648:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651127.686689:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788651127.686702:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651127.686716:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408283648:0@lo:400:kworker.0 00000100:00100000:2.0:1788651127.686759:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283904 00000100:00100000:2.0:1788651127.686792:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788651127.686797:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408283904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651127.686838:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408283904:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651127.686844:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788651127.687077:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651127.687150:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788651127.687156:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788651127.687183:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408283904:0@lo:400:kworker.0 00000100:00100000:3.0:1788651127.691975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651127.693179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408283520 00000100:00100000:2.0:1788651127.693192:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408283520 00000100:00100000:2.0:1788651127.693265:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651127.693276:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408283520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651127.693469:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d76c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408283520:12345-0@lo:400:kworker.0 Request processed in 194us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651127.693478:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788651127.693679:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651127.694134:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408283520:0@lo:400:kworker.0 00010000:00010000:2.0:1788651128.132893:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651128.204580:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651128.204603:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408284032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651128.204669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651128.204837:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284032 00000100:00100000:3.0:1788651128.204846:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284032 00000100:00100000:3.0:1788651128.204902:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788651128.204913:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408284032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651128.204951:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651128.204998:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408284032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651128.205004:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788651128.205087:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408284032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651129.156731:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651129.739786:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651129.739809:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408284160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651129.739893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651129.739956:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284160 00000100:00100000:3.0:1788651129.739964:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284160 00000100:00100000:3.0:1788651129.740022:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651129.740031:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408284160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651129.740069:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651129.740130:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d514000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408284160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651129.740137:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788651129.740158:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651129.740192:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d515c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408284160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651129.819654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651129.819703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651129.819742:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651129.819764:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651129.819788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651129.819839:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403392 00000100:00100000:1.0:1788651129.819850:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403392 00000100:00100000:1.0:1788651129.819914:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403520 00000100:00100000:1.0:1788651129.819918:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403520 00000100:00100000:1.0:1788651129.819943:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:1.0:1788651129.819954:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389403392:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651129.820021:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389403392:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651129.820028:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:1.0:1788651129.820045:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1788651129.820052:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389403520:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651129.820077:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389403520:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651129.820083:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:1.0:1788651129.820101:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403648 00000100:00100000:1.0:1788651129.820104:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403648 00000100:00100000:1.0:1788651129.820147:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403264 00000100:00100000:1.0:1788651129.820150:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403264 00000100:00100000:1.0:1788651129.820166:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 129 00000100:00100000:1.0:1788651129.820173:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389403648:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651129.820202:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389403648:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651129.820208:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 129 00000100:00100000:1.0:1788651129.820220:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 130 00000100:00100000:1.0:1788651129.820226:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2356:x1875536389403264:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651129.820247:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2356:x1875536389403264:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 21us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651129.820375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403136 00000100:00100000:3.0:1788651129.820380:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403136 00000100:00100000:3.0:1788651129.820413:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 283 00000100:00100000:3.0:1788651129.820420:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389403136:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651129.820451:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389403136:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651129.820458:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 283 00000100:00080000:3.0:1788651129.820484:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651129.820488:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651129.820490:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651129.822478:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 130 00010000:00010000:2.0:1788651130.181394:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651130.702137:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651130.702162:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651130.706777:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788651130.706796:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651130.785975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651130.786082:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389403776 00000100:00100000:3.0:1788651130.786093:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389403776 00000100:00100000:3.0:1788651130.786246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 135 00000100:00100000:3.0:1788651130.786258:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be751cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10223:x1875536389403776:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788651130.786390:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be751cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10223:x1875536389403776:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 Request processed in 134us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651130.786399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 135 00000100:00100000:0.0:1788651130.791333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651130.791436:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404032 00000100:00100000:2.0:1788651130.791448:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404032 00000100:00100000:2.0:1788651130.791514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:2.0:1788651130.791528:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:10223:x1875536389404032:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788651130.791995:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:10223:x1875536389404032:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 467us (677us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788651130.792004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1788651131.085916:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651131.086456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404160 00000100:00100000:3.0:1788651131.086470:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404160 00000100:00100000:3.0:1788651131.086568:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 136 00000100:00100000:3.0:1788651131.086582:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:11023:x1875536389404160:12345-192.168.203.21@tcp:101:lsof.0 00000100:00080000:0.0:1788651131.087015:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788651131.087453:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651131.087485:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c223 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651131.087574:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651131.087604:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651131.087621:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651131.087686:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788651131.087691:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651131.087740:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651131.087769:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977b61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651131.087919:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651131.087931:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:3.0:1788651131.087934:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651131.087939:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56cc00, rc 0) 00000100:00100000:3.0:1788651131.088094:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:11023:x1875536389404160:12345-192.168.203.21@tcp:101:lsof.0 Request processed in 1515us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651131.088103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 136 00010000:00010000:2.0:1788651131.204771:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788651131.336027:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1788651131.336056:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788651131.336101:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788651131.336268:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788651132.228286:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651132.805683:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408284672:0@lo:400:kworker.0 00000100:00100000:2.0:1788651132.805758:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651132.805841:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651132.805848:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408284544:0@lo:400:kworker.0 00000100:00100000:2.0:1788651132.805875:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651132.805918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284544 00000100:00100000:2.0:1788651132.805927:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284544 00000100:00100000:2.0:1788651132.805985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788651132.805994:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408284544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651132.806048:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408284544:12345-0@lo:400:kworker.0 Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651132.806056:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788651132.806076:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651132.806143:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408284544:0@lo:400:kworker.0 00000100:00100000:1.0:1788651132.806151:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284672 00000100:00100000:1.0:1788651132.806158:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284672 00000100:00100000:1.0:1788651132.806207:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788651132.806216:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408284672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651132.806257:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408284672:12345-0@lo:400:kworker.0 Request processed in 44us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651132.806263:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788651132.806279:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651132.806296:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408284672:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806479:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408284416:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806512:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651132.806542:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408284928:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806564:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651132.806601:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788651132.806608:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408284288:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651132.806657:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408284800:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806694:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651132.806721:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284288 00000100:00100000:3.0:1788651132.806725:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284288 00000100:00100000:3.0:1788651132.806752:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788651132.806758:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408284288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806806:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408284288:12345-0@lo:400:kworker.0 Request processed in 34us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651132.806813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788651132.806850:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408284288:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806868:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284416 00000100:00100000:3.0:1788651132.806871:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284416 00000100:00100000:3.0:1788651132.806891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284800 00000100:00100000:3.0:1788651132.806894:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284800 00000100:00100000:3.0:1788651132.806915:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788651132.806921:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408284416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.806956:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408284416:12345-0@lo:400:kworker.0 Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651132.806962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788651132.806973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788651132.806979:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408284800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.807005:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408284800:12345-0@lo:400:kworker.0 Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651132.807010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788651132.807023:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651132.807040:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408284800:0@lo:400:kworker.0 00000100:00100000:3.0:1788651132.807049:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408284416:0@lo:400:kworker.0 00000100:00100000:2.0:1788651132.807447:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408284928 00000100:00100000:2.0:1788651132.807452:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408284928 00000100:00100000:2.0:1788651132.807537:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788651132.807545:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408284928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651132.807606:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d514e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408284928:12345-0@lo:400:kworker.0 Request processed in 62us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651132.807613:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788651132.807667:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408284928:0@lo:400:kworker.0 00000100:00080000:3.0:1788651132.808683:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788651133.252388:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651133.316346:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651133.316369:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408285056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651133.316439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651133.316578:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285056 00000100:00100000:3.0:1788651133.316588:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285056 00000100:00100000:3.0:1788651133.316656:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651133.316666:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408285056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651133.316701:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651133.316753:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408285056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651133.316759:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788651133.316824:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408285056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651134.276495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651134.853261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651134.853284:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408285184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651134.853361:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651134.853423:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285184 00000100:00100000:3.0:1788651134.853431:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285184 00000100:00100000:3.0:1788651134.853487:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788651134.853496:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408285184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651134.853529:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651134.853570:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408285184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651134.853577:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788651134.853596:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651134.853606:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408285184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651134.943994:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651134.944036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651134.944064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651134.944088:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651134.944098:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404544 00000100:00100000:2.0:1788651134.944129:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404544 00000100:00100000:3.0:1788651134.944136:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651134.944167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404288 00000100:00100000:3.0:1788651134.944178:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404288 00000100:00100000:2.0:1788651134.944202:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404672 00000100:00100000:2.0:1788651134.944207:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404672 00000100:00100000:3.0:1788651134.944214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 285 00000100:00100000:3.0:1788651134.944227:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389404288:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651134.944238:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:2.0:1788651134.944249:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389404544:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651134.944298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389404288:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651134.944305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 285 00000100:00100000:3.0:1788651134.944341:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404800 00000100:00100000:3.0:1788651134.944344:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404800 00000100:00100000:3.0:1788651134.944375:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389404416 00000100:00100000:3.0:1788651134.944378:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389404416 00000100:00100000:3.0:1788651134.944398:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 134 00000100:00100000:3.0:1788651134.944405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2355:x1875536389404800:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651134.944438:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2355:x1875536389404800:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651134.944445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 134 00000100:00100000:3.0:1788651134.944458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 135 00000100:00100000:3.0:1788651134.944467:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2355:x1875536389404416:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651134.944494:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2355:x1875536389404416:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651134.944501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 135 00000100:00100000:3.0:1788651134.944526:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:3.0:1788651134.944535:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389404672:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651134.944563:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389404672:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651134.944570:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:2.0:1788651134.944731:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389404544:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 483us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651134.944739:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00080000:3.0:1788651134.947713:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651134.947721:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651134.947725:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788651135.168086:0:12291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:32:14 (1788651134) 00010000:00010000:3.0:1788651135.304417:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651136.324361:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651136.695236:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651136.695408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405056 00000100:00100000:1.0:1788651136.695420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405056 00000100:00100000:1.0:1788651136.695497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 137 00000100:00100000:1.0:1788651136.695509:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:11288:x1875536389405056:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651136.695529:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651136.695548:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977b6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c22a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.695690:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.695705:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.695730:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.695799:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.695808:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.695814:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651136.696077:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651136.696941:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977b84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.696953:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977b84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.696959:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977b84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651136.696967:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788651136.697093:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697099:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697103:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697120:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651136.697129:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697135:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697145:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93be449ae600) 00010000:00010000:1.0:1788651136.697147:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651136.697150:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697154:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977b76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697163:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697166:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697169:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697173:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651136.697175:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697178:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697181:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93be58f79200) 00010000:00010000:1.0:1788651136.697183:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651136.697188:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697191:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977b7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697510:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977b6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c22a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697524:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977b84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c22a expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.697533:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:1.0:1788651136.697535:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651136.697537:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c800, rc 0) 00000100:00100000:1.0:1788651136.697718:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:11288:x1875536389405056:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 2211us (2488us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788651136.697728:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 137 00000100:00100000:3.0:1788651136.703484:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651136.703529:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651136.703653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405184 00000100:00100000:0.0:1788651136.703677:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405184 00000100:00100000:0.0:1788651136.703737:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 138 00000100:00100000:0.0:1788651136.703750:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:11288:x1875536389405184:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788651136.703795:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405312 00000100:00100000:1.0:1788651136.703801:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405312 00000100:00100000:1.0:1788651136.703849:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1788651136.703858:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:2356:x1875536389405312:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651136.703869:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651136.703891:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977b84 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c22a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651136.703910:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:1.0:1788651136.703915:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651136.703967:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:11288:x1875536389405184:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 Request processed in 219us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651136.704043:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 138 00000100:00100000:1.0:1788651136.704179:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:2356:x1875536389405312:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 322us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651136.704187:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000040:00080000:2.0:1788651136.836478:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651136.836501:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651136.836927:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788651136.836935:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788651137.349294:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651137.927310:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408285312:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651137.927487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285312 00000100:00100000:1.0:1788651137.927494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285312 00000100:00100000:1.0:1788651137.927544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788651137.927566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408285312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408285312:12345-0@lo:400:kworker.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651137.927633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788651137.927694:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408285312:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927735:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408285440:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927779:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651137.927817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285440 00000100:00100000:1.0:1788651137.927821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285440 00000100:00100000:1.0:1788651137.927850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788651137.927856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408285440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927894:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408285440:12345-0@lo:400:kworker.0 Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651137.927900:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788651137.927930:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408285440:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927971:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408285568:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.927998:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651137.928065:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285568 00000100:00100000:1.0:1788651137.928069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285568 00000100:00100000:1.0:1788651137.928101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788651137.928137:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928176:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408285568:12345-0@lo:400:kworker.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651137.928183:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788651137.928208:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408285568:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928240:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408285696:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651137.928301:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285696 00000100:00100000:1.0:1788651137.928305:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285696 00000100:00100000:1.0:1788651137.928333:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788651137.928340:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408285696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928377:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408285696:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651137.928383:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788651137.928410:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408285696:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928442:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408285824:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928464:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651137.928487:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285824 00000100:00100000:1.0:1788651137.928490:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285824 00000100:00100000:1.0:1788651137.928512:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788651137.928517:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408285824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928548:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408285824:12345-0@lo:400:kworker.0 Request processed in 31us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651137.928564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788651137.928594:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408285824:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928624:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408285952:0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928647:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651137.928670:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408285952 00000100:00100000:1.0:1788651137.928674:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408285952 00000100:00100000:1.0:1788651137.928696:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788651137.928701:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408285952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651137.928732:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408285952:12345-0@lo:400:kworker.0 Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651137.928737:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788651137.928769:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408285952:0@lo:400:kworker.0 00000100:00080000:3.0:1788651137.928988:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651137.928993:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651137.928995:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788651138.372342:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651138.436271:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408286080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651138.436341:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651138.436452:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408286080 00000100:00100000:2.0:1788651138.436462:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408286080 00000100:00100000:2.0:1788651138.436519:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788651138.436530:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408286080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651138.436575:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651138.436624:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408286080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651138.436631:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788651138.436676:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408286080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651138.493738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651138.495642:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405440 00000100:00100000:0.0:1788651138.495657:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405440 00000100:00100000:0.0:1788651138.495783:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 139 00000100:00100000:0.0:1788651138.495795:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:11331:x1875536389405440:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651138.495825:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651138.495846:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c231 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.495908:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.495922:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.495933:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.495947:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.495954:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.495961:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496176:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496185:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496191:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496197:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651138.496201:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496207:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496218:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:0.0:1788651138.496221:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651138.496226:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496232:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977b99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496241:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496246:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496252:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496263:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651138.496266:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496272:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496279:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93be44b46400) 00010000:00010000:0.0:1788651138.496281:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651138.496284:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496289:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977ba0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496320:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977b92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c231 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496329:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:0.0:1788651138.496331:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651138.496334:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c231 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.496341:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860a00, rc 0) 00000100:00100000:0.0:1788651138.496405:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:11331:x1875536389405440:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 612us (2675us total) trans 0 rc 301/301 00000100:00100000:0.0:1788651138.496411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 139 00000100:00080000:1.0:1788651138.496843:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651138.518703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651138.518781:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405696 00000100:00100000:1.0:1788651138.518792:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405696 00000100:00100000:1.0:1788651138.518852:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 140 00000100:00100000:1.0:1788651138.518863:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:11331:x1875536389405696:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:1.0:1788651138.518917:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651138.518944:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba887977510 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c06a expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.518961:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:1.0:1788651138.518974:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651138.519202:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.519217:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.519227:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.519263:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.519277:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 5 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651138.519293:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7586ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408286208:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651138.519382:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a1a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651138.528772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.528809:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405824 00000100:00100000:3.0:1788651138.528819:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405824 00010000:00010000:3.0:1788651138.528875:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 6 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651138.528913:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1788651138.528923:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2356:x1875536389405824:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651138.528938:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651138.528946:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 6 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.528959:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 6 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.528980:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:3.0:1788651138.528992:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.529002:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.529010:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.529027:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651138.529073:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2356:x1875536389405824:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 151us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651138.529080:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00080000:3.0:1788651138.529100:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788651138.531784:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977b68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c223 expref: 5 pid: 5841 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651138.531808:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7586ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408286208:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651138.531833:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.531843:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.531850:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.531875:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.531888:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.531906:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651138.535825:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788651138.535842:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.535852:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.535860:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.535866:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651138.535871:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.535879:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.535893:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79e00) 00010000:00010000:3.0:1788651138.535896:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651138.535900:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.535906:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977ba7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651138.535924:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbd295dc reply state 000000001a598c56 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651138.535944:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651138.536030:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:11331:x1875536389405696:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 17166us (17332us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788651138.536039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 140 00010000:00010000:0.0:1788651138.554278:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.554302:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.554311:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.554317:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651138.554322:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.554330:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.554344:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93be51759300) 00010000:00010000:0.0:1788651138.554348:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651138.554352:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.554359:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977bae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651138.628768:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.628830:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389405952 00000100:00100000:2.0:1788651138.628840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389405952 00000100:00100000:2.0:1788651138.628891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 141 00000100:00100000:2.0:1788651138.628899:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+14:11339:x1875536389405952:12345-192.168.203.21@tcp:101:lctl.0 00010000:00010000:2.0:1788651138.628921:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651138.628938:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977bb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c238 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.628990:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887977bbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.629001:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887977bbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.629009:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887977bbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651138.629047:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651138.629050:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651138.629638:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887977bbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.629672:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977bb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c238 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.629693:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887977bbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c238 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.629702:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:3.0:1788651138.629705:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651138.629709:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b400, rc 0) 00000100:00100000:3.0:1788651138.629786:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:11339:x1875536389405952:12345-192.168.203.21@tcp:101:lctl.0 Request processed in 887us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651138.629794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 141 00000100:00100000:3.0:1788651138.700284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.700462:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389406080 00000100:00100000:2.0:1788651138.700474:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389406080 00000100:00100000:2.0:1788651138.700558:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 142 00000100:00100000:2.0:1788651138.700569:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+15:11345:x1875536389406080:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651138.700602:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651138.700629:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977bc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c23f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700718:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700736:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700750:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700778:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700786:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700792:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700910:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977bd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700936:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.700943:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651138.700990:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788651138.700994:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651138.701016:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701034:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701042:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701050:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701056:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651138.701062:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701070:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701083:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:2.0:1788651138.701086:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651138.701092:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701153:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977bca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701170:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701186:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701193:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701198:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651138.701201:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701206:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701214:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93be449aef00) 00010000:00010000:2.0:1788651138.701217:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651138.701219:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701225:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977bd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701262:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977bc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c23f expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701277:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c23f expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.701292:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651138.701294:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788651138.701297:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b600, rc 0) 00000100:00100000:2.0:1788651138.701381:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:11345:x1875536389406080:12345-192.168.203.21@tcp:101:bash.0 Request processed in 813us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651138.701389:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 142 00000100:00100000:2.0:1788651138.707272:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651138.707391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389406336 00000100:00100000:0.0:1788651138.707408:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389406336 00000100:00100000:0.0:1788651138.707487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 143 00000100:00100000:0.0:1788651138.707507:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+16:11345:x1875536389406336:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1788651138.707528:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651138.707548:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977bdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c246 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.707700:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.707715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.707727:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.707799:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.707808:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.707815:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651138.708356:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788651138.708508:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708518:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708526:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708556:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708574:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708581:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708587:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651138.708592:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708599:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708610:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651138.708613:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651138.708618:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708625:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977be6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651138.708638:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002c0b568 reply state 0000000013e606bf transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651138.708647:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788651138.708675:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977bdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708687:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.708705:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:0.0:1788651138.708707:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651138.708709:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860400, rc 0) 00000100:00100000:0.0:1788651138.708803:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11345:x1875536389406336:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1298us (1545us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788651138.708811:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 143 00010000:00010000:2.0:1788651138.721445:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651138.721452:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:2.0:1788651138.721469:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.721481:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.721488:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651138.721494:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.721503:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.721526:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be44b46400) 00010000:00010000:2.0:1788651138.721530:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651138.721535:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.721546:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887977bed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651138.721702:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389406464 00000100:00100000:1.0:1788651138.721713:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389406464 00000100:00100000:1.0:1788651138.721789:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1788651138.721800:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2356:x1875536389406464:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:1.0:1788651138.721817:0:10263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651138.721835:0:10263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c24d expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651138.721860:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788651138.721879:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1788651138.721893:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651138.721902:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 6 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.721922:0:10263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 6 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.721936:0:10263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9cc00, rc 0) 00000100:00100000:1.0:1788651138.722003:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389406464:12345-192.168.203.21@tcp:101:bash.0 Request processed in 205us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651138.722011:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00080000:3.0:1788651138.722172:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651138.726309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.726394:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389406592 00000100:00100000:2.0:1788651138.726405:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389406592 00000100:00100000:2.0:1788651138.726469:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:2.0:1788651138.726481:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:11345:x1875536389406592:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651138.726509:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651138.726527:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c254 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.726556:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 7 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.726565:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651138.726569:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651138.726575:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.726610:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 7 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.726623:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 7 pid: 10263 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.726637:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408286336:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651138.726728:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651138.733376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.733470:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389406720 00000100:00100000:3.0:1788651138.733481:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389406720 00010000:00010000:3.0:1788651138.733532:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 8 pid: 10263 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651138.733592:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:3.0:1788651138.733603:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389406720:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651138.733619:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651138.733644:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 8 pid: 10263 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.733659:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 8 pid: 10263 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.733681:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651138.733686:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651138.733695:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.733705:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.733741:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651138.733773:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875536408286464:192.168.203.21@tcp:105: 00000100:00100000:3.0:1788651138.733844:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788651138.734211:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8485144/0x84a2fba887977c02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c24d expref: 8 pid: 10263 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651138.734225:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408286336:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651138.734247:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.734257:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ae00, rc 0) 00000100:00100000:1.0:1788651138.734286:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:11345:x1875536389406592:12345-192.168.203.21@tcp:101:bash.0 Request processed in 7808us (7987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651138.734293:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:3.0:1788651138.736437:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875536408286464:192.168.203.21@tcp:105: 00010000:00010000:3.0:1788651138.736472:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651138.736531:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389406720:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 2928us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651138.736540:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:1.0:1788651138.737366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.737428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389406976 00000100:00100000:3.0:1788651138.737436:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389406976 00000100:00100000:3.0:1788651138.737495:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:3.0:1788651138.737505:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:11345:x1875536389406976:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:3.0:1788651138.737830:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11345:x1875536389406976:12345-192.168.203.21@tcp:35:bash.0 Request processed in 325us (466us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788651138.737838:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:2.0:1788651138.815685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.815799:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389407232 00000100:00100000:3.0:1788651138.815811:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389407232 00000100:00100000:3.0:1788651138.815880:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 144 00000100:00100000:3.0:1788651138.815893:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11355:x1875536389407232:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651138.815918:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651138.815938:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c25b expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651138.820750:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788651138.821298:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977c10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c25b expref: 21 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.821317:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:2.0:1788651138.821320:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651138.821326:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c25b expref: 21 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.821342:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56cc00, rc 0) 00000100:00100000:2.0:1788651138.821422:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11355:x1875536389407232:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 5532us (5745us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788651138.821431:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 144 00000100:00100000:0.0:1788651138.825063:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.825157:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389407488 00000100:00100000:2.0:1788651138.825168:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389407488 00000100:00100000:2.0:1788651138.825226:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:2.0:1788651138.825237:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11355:x1875536389407488:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651138.825474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:11355:x1875536389407488:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 238us (419us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788651138.825482:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:1.0:1788651138.921997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651138.922071:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389407616 00000100:00100000:0.0:1788651138.922083:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389407616 00000100:00100000:0.0:1788651138.922344:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 145 00000100:00100000:0.0:1788651138.922359:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:11361:x1875536389407616:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651138.922385:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651138.922407:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c262 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.922622:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977c25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.922638:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.922796:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651138.922834:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788651138.922838:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651138.922877:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977c25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.922906:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c262 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.922925:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977c25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c262 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.922935:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651138.922938:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651138.922941:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861800, rc 0) 00000100:00100000:0.0:1788651138.923150:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:11361:x1875536389407616:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 751us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651138.923160:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 145 00000100:00100000:1.0:1788651138.927323:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.927418:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389407872 00000100:00100000:3.0:1788651138.927432:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389407872 00000100:00100000:3.0:1788651138.927709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 146 00000100:00100000:3.0:1788651138.927722:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:11361:x1875536389407872:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651138.927743:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651138.927772:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977c2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c269 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.927881:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977c33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.927895:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.927906:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651138.927917:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788651138.928036:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977c2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c269 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.928055:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c269 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651138.928078:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:3.0:1788651138.928081:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651138.928084:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d800, rc 0) 00000100:00100000:3.0:1788651138.928175:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11361:x1875536389407872:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 455us (994us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788651138.928183:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 146 00000100:00100000:3.0:1788651138.930807:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.930987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651138.931075:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389408256 00000100:00100000:1.0:1788651138.931085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389408256 00000100:00100000:1.0:1788651138.931175:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 147 00000100:00100000:1.0:1788651138.931187:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11361:x1875536389408256:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651138.931212:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651138.931232:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977c41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c270 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.931325:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977c48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.931340:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.931351:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651138.931362:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788651138.931472:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977c41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c270 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.931488:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c270 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.931496:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:1.0:1788651138.931499:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788651138.931502:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:1.0:1788651138.931556:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11361:x1875536389408256:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 371us (569us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788651138.931577:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 147 00000100:00100000:0.0:1788651138.932087:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389408000 00000100:00100000:0.0:1788651138.932093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389408000 00000100:00100000:0.0:1788651138.933236:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1788651138.933251:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:2354:x1875536389408000:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651138.933272:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651138.933295:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977c33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c269 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.933313:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:0.0:1788651138.933318:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651138.933379:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+25:2354:x1875536389408000:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 133us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651138.933387:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1788651138.936430:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.936517:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389408384 00000100:00100000:2.0:1788651138.936528:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389408384 00000100:00100000:2.0:1788651138.936583:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:2.0:1788651138.936594:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389408384:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:2.0:1788651138.936637:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.936675:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.936683:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651138.936688:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651138.936693:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.936734:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.936749:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 6 pid: 6672 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.936777:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1875536408286592:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651138.936895:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651138.940633:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1875536408286592:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651138.940664:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.940680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651138.940731:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389408512 00000100:00100000:0.0:1788651138.940740:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389408512 00002000:00100000:0.0:1788651138.940801:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93be74f94000 x1875536389408512/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:279/0 lens 504/0 e 0 to 0 dl 1788651149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788651138.940811:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be74f94000 with x1875536389408512 ext(0->12) 00010000:00010000:0.0:1788651138.940819:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 7 pid: 6672 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.941365:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 7 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651138.941374:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be74f94000 00000100:00100000:0.0:1788651138.941461:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1788651138.941473:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389408512:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:0.0:1788651138.941955:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389408512:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 483us (1276us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788651138.941963:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00002000:00100000:0.0:1788651138.941971:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93be74f94000 x1875536389408512/t4294967305(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:279/0 lens 504/448 e 0 to 0 dl 1788651149 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788651138.941980:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be74f94000 with x1875536389408512 ext(0->12) 00010000:00010000:0.0:1788651138.941988:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 9 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.942004:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 9 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651138.942022:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be74f94000 00000100:00100000:3.0:1788651138.944315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.944416:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389408640 00000100:00100000:2.0:1788651138.944425:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389408640 00010000:00010000:2.0:1788651138.944461:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 9 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.944532:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:2.0:1788651138.944542:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389408640:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651138.944557:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788651138.944581:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788651138.944582:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788651139 00002000:00010000:2.0:1788651138.944584:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788651139 00002000:00010000:2.0:1788651138.944585:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788651139 00010000:00010000:2.0:1788651138.944591:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 9 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.944604:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 9 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.944627:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba887977c09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c254 expref: 9 pid: 6672 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.944640:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788651138.944644:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651138.944650:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.944659:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.944687:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651138.944786:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944796:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.944812:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389408640:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 271us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651138.944819:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00010000:00010000:1.0:1788651138.944822:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944830:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944837:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944845:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651138.944849:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944862:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944880:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651138.944887:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887977c56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651138.944928:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389408384:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 8337us (8506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651138.944935:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:1.0:1788651138.946878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.946917:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389408896 00000100:00100000:2.0:1788651138.946927:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389408896 00000100:00100000:2.0:1788651138.946970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:2.0:1788651138.946989:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57baf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+25:11361:x1875536389408896:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:2.0:1788651138.947047:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c270 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651138.947276:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788651138.947314:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788651138.947662:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788651138.947701:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.947712:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.947718:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.947742:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.947764:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 29 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.947775:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875536408286720:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651138.947838:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651138.949919:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875536408286720:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651138.949945:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651138.950638:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.950716:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389409024 00000100:00100000:2.0:1788651138.950724:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389409024 00010000:00010000:2.0:1788651138.950775:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 30 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.951073:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:2.0:1788651138.951086:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:2355:x1875536389409024:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651138.951101:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651138.951142:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 30 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.951157:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 30 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.951179:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977bf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c246 expref: 30 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.951196:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:2.0:1788651138.951202:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.951211:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.951219:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.951245:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651138.951270:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.951280:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651138.951307:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:2355:x1875536389409024:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 224us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651138.951316:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000001:00080000:0.0:1788651138.951413:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788651138.951601:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788651138.951706:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408286848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788651138.951749:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651138.951789:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651138.952548:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408286848 00000100:00100000:3.0:1788651138.952565:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408286848 00000100:00100000:3.0:1788651138.952616:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788651138.952626:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875536408286848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788651138.952709:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875536408286848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651138.952716:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788651138.952832:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408286848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788651138.953273:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788651138.953350:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408286976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788651138.953396:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651138.953422:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651138.953549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408286976 00000100:00100000:3.0:1788651138.953555:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408286976 00000100:00100000:3.0:1788651138.953591:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788651138.953599:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875536408286976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788651138.954414:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bf0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875536408286976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 812us (1014us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788651138.954424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651138.954448:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408286976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788651138.954507:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788651138.954545:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.954557:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.954565:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.954582:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618aa00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651138.954599:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.954607:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.954623:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:0.0:1788651138.954626:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788651138.954631:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651138.954638:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977c5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651138.954822:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788651138.954999:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788651138.955011:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343014903077ns, next at 344014900822ns, rc = 0 00000001:00080000:0.0:1788651138.955017:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788651138.955144:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be44b46300) 00010000:00010000:0.0:1788651138.955147:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788651138.955154:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977c48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c270 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651138.955259:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57baf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11361:x1875536389408896:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 8272us (8384us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788651138.955267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00000020:00080000:0.0:1788651138.955271:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788651138.963944:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651138.964419:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389409152 00000100:00100000:2.0:1788651138.964433:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389409152 00000100:00100000:2.0:1788651138.964511:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 148 00000100:00100000:2.0:1788651138.964523:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11361:x1875536389409152:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651138.964563:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651138.964594:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977c64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c277 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.964671:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977c64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c277 expref: 33 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.964688:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977c64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c277 expref: 33 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651138.964723:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651138.964726:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651138.964895:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b800, rc 0) 00000100:00100000:2.0:1788651138.964984:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:11361:x1875536389409152:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 463us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651138.964993:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 148 00000100:00100000:2.0:1788651138.970697:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651138.970811:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389409408 00000100:00100000:3.0:1788651138.970822:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389409408 00000100:00100000:3.0:1788651138.970886:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:3.0:1788651138.970902:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+33:11361:x1875536389409408:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1788651138.971166:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:11361:x1875536389409408:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 269us (478us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788651138.971174:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:1.0:1788651139.023466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.023548:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389409664 00000100:00100000:3.0:1788651139.023560:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389409664 00000100:00100000:3.0:1788651139.023649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 149 00000100:00100000:3.0:1788651139.023660:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:11371:x1875536389409664:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651139.023682:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651139.023700:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977c6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c27e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651139.023806:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788651139.023912:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977c6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c27e expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.023926:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:3.0:1788651139.023929:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651139.023935:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977c6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c27e expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.023949:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c800, rc 0) 00000100:00100000:3.0:1788651139.024025:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11371:x1875536389409664:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 365us (566us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788651139.024032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 149 00000100:00100000:1.0:1788651139.027037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.027172:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389409792 00000100:00100000:2.0:1788651139.027184:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389409792 00000100:00100000:2.0:1788651139.027238:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 150 00000100:00100000:2.0:1788651139.027248:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11371:x1875536389409792:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:2.0:1788651139.027341:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027359:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027370:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027387:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027395:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027400:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027467:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027472:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027477:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651139.027508:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027517:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027528:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027533:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027536:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.027540:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027547:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027558:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651139.027561:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.027566:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027572:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027584:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027590:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027597:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027601:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.027608:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027612:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027617:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be449aeb00) 00010000:00010000:2.0:1788651139.027619:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.027621:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027624:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027634:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027637:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027640:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027643:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.027645:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027648:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027651:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.027652:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.027657:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.027661:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651139.027718:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11371:x1875536389409792:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 471us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651139.027725:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 150 00000100:00100000:0.0:1788651139.029378:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.029973:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389410048 00000100:00100000:3.0:1788651139.029984:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389410048 00000100:00100000:3.0:1788651139.030247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:3.0:1788651139.030260:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11371:x1875536389410048:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1788651139.030464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:11371:x1875536389410048:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 207us (1092us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788651139.030469:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:1.0:1788651139.059731:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.059792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389410304 00000100:00100000:2.0:1788651139.059802:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389410304 00000100:00100000:2.0:1788651139.059852:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 151 00000100:00100000:2.0:1788651139.059859:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:11374:x1875536389410304:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651139.059879:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651139.059895:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c285 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.059974:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.059987:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.059999:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060013:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060020:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060044:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060179:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651139.060190:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788651139.060264:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060273:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060280:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060285:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.060289:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060297:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060309:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651139.060312:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.060326:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060332:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060344:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060349:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060354:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060359:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.060361:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060367:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060374:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be449aeb00) 00010000:00010000:2.0:1788651139.060376:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.060379:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060383:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060421:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977c8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060447:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.060453:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.060455:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651139.060458:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618aa00, rc 0) 00000100:00100000:2.0:1788651139.060610:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11374:x1875536389410304:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 750us (885us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788651139.060615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 151 00000100:00100000:1.0:1788651139.063072:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.063148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389410432 00000100:00100000:3.0:1788651139.063158:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389410432 00000100:00100000:3.0:1788651139.063215:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 152 00000100:00100000:3.0:1788651139.063227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11374:x1875536389410432:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1788651139.063290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063316:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063334:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063364:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063370:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063378:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063384:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651139.063388:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063395:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063405:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:3.0:1788651139.063408:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651139.063412:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.063419:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651139.063547:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11374:x1875536389410432:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 321us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651139.063560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 152 00000100:00100000:0.0:1788651139.065705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.065869:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389410688 00000100:00100000:2.0:1788651139.065879:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389410688 00000100:00100000:2.0:1788651139.065932:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:2.0:1788651139.065942:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11374:x1875536389410688:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651139.066182:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:11374:x1875536389410688:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 240us (483us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788651139.066189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1788651139.258457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.258578:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389410944 00000100:00100000:3.0:1788651139.258590:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389410944 00000100:00100000:3.0:1788651139.258654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 153 00000100:00100000:3.0:1788651139.258676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:11405:x1875536389410944:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:3.0:1788651139.258699:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651139.258717:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c28c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.258808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.258819:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.258828:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651139.258835:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788651139.258932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c28c expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.258945:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c28c expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.258951:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:3.0:1788651139.258954:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651139.258956:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c000, rc 0) 00000100:00100000:3.0:1788651139.259034:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:11405:x1875536389410944:12345-192.168.203.21@tcp:101:cat.0 Request processed in 369us (584us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788651139.259042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 153 00000100:00100000:1.0:1788651139.262165:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.262204:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389411200 00000100:00100000:3.0:1788651139.262214:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389411200 00000100:00100000:3.0:1788651139.262269:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:3.0:1788651139.262280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:11405:x1875536389411200:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:3.0:1788651139.262560:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:11405:x1875536389411200:12345-192.168.203.21@tcp:35:cat.0 Request processed in 277us (398us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788651139.262568:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:1.0:1788651139.262651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.263055:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389411328 00000100:00100000:2.0:1788651139.263061:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389411328 00000100:00100000:2.0:1788651139.263125:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:2.0:1788651139.263135:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:2354:x1875536389411328:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651139.263158:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651139.263181:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c28c expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.263199:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.263217:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651139.263254:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:2354:x1875536389411328:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 121us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651139.263262:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651139.309254:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.309499:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389411584 00000100:00100000:2.0:1788651139.309512:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389411584 00000100:00100000:2.0:1788651139.309627:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 154 00000100:00100000:2.0:1788651139.309638:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:11411:x1875536389411584:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:2.0:1788651139.309661:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651139.309663:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651139.309686:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977c25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c262 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.309704:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651139.309708:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651139.309721:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977ccd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c293 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.309818:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.309831:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.309838:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.309871:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.309901:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 41 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651139.309915:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408287104:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651139.310014:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651139.313295:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651139.313352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389411712 00000100:00100000:0.0:1788651139.313363:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389411712 00000100:00100000:2.0:1788651139.313396:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408287104:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651139.313403:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 42 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.313422:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651139.313445:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:0.0:1788651139.313452:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:2356:x1875536389411712:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651139.313464:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651139.313470:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 42 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.313480:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 42 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.313495:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c285 expref: 42 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.313506:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:0.0:1788651139.313509:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.313516:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.313521:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.313547:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651139.313612:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.313620:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651139.313641:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788651139.313805:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977ccd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 43 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.313821:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 42 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.313828:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.313831:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651139.313833:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ac00, rc 0) 00000100:00100000:2.0:1788651139.313911:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:11411:x1875536389411584:12345-192.168.203.21@tcp:101:dd.0 Request processed in 4275us (4665us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788651139.313931:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 154 00000100:00100000:0.0:1788651139.313932:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:2356:x1875536389411712:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 475us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651139.313943:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:0.0:1788651139.318073:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.318342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389411968 00000100:00100000:3.0:1788651139.318352:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389411968 00000100:00100000:3.0:1788651139.318418:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 155 00000100:00100000:3.0:1788651139.318429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:11411:x1875536389411968:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:3.0:1788651139.318726:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.318743:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.318770:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651139.318819:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788651139.318842:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d35245c reply state 00000000cdb976c7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651139.318852:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651139.318939:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+44:11411:x1875536389411968:12345-192.168.203.21@tcp:36:dd.0 Request processed in 512us (875us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788651139.318958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 155 00000020:00080000:3.0:1788651139.318963:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788651139.320923:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.320941:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.320949:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.320955:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651139.320960:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.320967:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.320983:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:0.0:1788651139.320986:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651139.320990:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.320997:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977ce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.396578:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651139.539029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.539139:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389412096 00000100:00100000:3.0:1788651139.539164:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389412096 00000100:00100000:3.0:1788651139.539222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 156 00000100:00100000:3.0:1788651139.539233:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:11425:x1875536389412096:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:3.0:1788651139.539258:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651139.539279:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977ce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c29a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539353:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539367:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539378:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539392:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539399:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539406:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539493:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539521:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 44 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539529:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539564:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 44 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.539578:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 44 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651139.539607:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408287232:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651139.539707:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651139.547374:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.547468:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389412352 00000100:00100000:2.0:1788651139.547478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389412352 00000100:00100000:2.0:1788651139.547539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:2.0:1788651139.547551:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:6052:x1875536389412352:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788651139.547890:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:6052:x1875536389412352:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 340us (523us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788651139.547898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1788651139.548379:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408287232:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651139.548406:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651139.553599:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.553670:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389412480 00000100:00100000:2.0:1788651139.553682:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389412480 00010000:00010000:2.0:1788651139.553736:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 46 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651139.553797:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:2.0:1788651139.553808:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:2356:x1875536389412480:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651139.553825:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651139.553833:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 46 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.553847:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 46 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.553868:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977cd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c293 expref: 46 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.553900:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.553905:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.553915:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.553922:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.553961:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651139.553985:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.553996:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651139.554017:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:2356:x1875536389412480:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 211us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651139.554025:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000004:00200000:3.0:1788651139.554047:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788651139.554052:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651139.554071:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554089:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554098:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554140:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554153:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554159:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651139.554163:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554170:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554180:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651139.554184:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651139.554188:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554199:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977cf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554210:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554215:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554228:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554233:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651139.554235:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554242:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554250:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be51759f00) 00010000:00010000:3.0:1788651139.554253:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651139.554257:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554262:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554302:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c29a expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.554997:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c29a expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.555011:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:3.0:1788651139.555014:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651139.555016:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c000, rc 0) 00000100:00100000:3.0:1788651139.555070:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+44:11425:x1875536389412096:12345-192.168.203.21@tcp:101:stat.0 Request processed in 15837us (16047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651139.555089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 156 00000100:00100000:1.0:1788651139.635649:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.636691:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389412736 00000100:00100000:2.0:1788651139.636705:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389412736 00000100:00100000:3.0:1788651139.636863:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 157 00000100:00100000:3.0:1788651139.636876:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+44:11431:x1875536389412736:12345-192.168.203.21@tcp:36:truncate.0 00010000:00010000:3.0:1788651139.636931:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651139.636954:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c29a expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.636973:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:3.0:1788651139.636979:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651139.637198:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.637213:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.637223:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651139.637272:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788651139.637296:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3036d96 reply state 0000000039d9228f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651139.637305:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651139.637404:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:11431:x1875536389412736:12345-192.168.203.21@tcp:36:truncate.0 Request processed in 531us (1763us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788651139.637411:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 157 00000020:00080000:3.0:1788651139.637416:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788651139.640311:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.640341:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.640348:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.640354:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651139.640359:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.640366:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.640381:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:3.0:1788651139.640384:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651139.640388:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.640395:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651139.765603:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.765689:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389412864 00000100:00100000:2.0:1788651139.765702:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389412864 00000100:00100000:2.0:1788651139.765775:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 158 00000100:00100000:2.0:1788651139.765787:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:11445:x1875536389412864:12345-192.168.203.21@tcp:101:stat.0 00010000:00010000:2.0:1788651139.765812:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651139.765832:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2a1 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.765897:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.765911:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.765931:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.765948:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.765956:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.765964:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766050:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766059:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766066:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651139.766140:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788651139.766145:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651139.766168:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766181:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766190:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766224:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766232:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766238:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.766243:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766262:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766275:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651139.766287:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.766292:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766300:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766315:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766321:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766327:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766332:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651139.766340:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766347:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766356:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be449aeb00) 00010000:00010000:2.0:1788651139.766359:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651139.766362:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766369:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766401:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 47 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766416:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 46 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.766423:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.766426:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651139.766428:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ae00, rc 0) 00000100:00100000:2.0:1788651139.766493:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:11445:x1875536389412864:12345-192.168.203.21@tcp:101:stat.0 Request processed in 708us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651139.766501:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 158 00000100:00100000:0.0:1788651139.842888:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.842943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389413120 00000100:00100000:2.0:1788651139.842952:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389413120 00000100:00100000:2.0:1788651139.843023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 159 00000100:00100000:2.0:1788651139.843031:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+46:11455:x1875536389413120:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651139.843066:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651139.843083:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2a8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651139.843184:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788651139.843298:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a8 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.843312:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:2.0:1788651139.843315:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651139.843321:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a8 expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.843334:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ac00, rc 0) 00000100:00100000:2.0:1788651139.843406:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:11455:x1875536389413120:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 374us (525us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788651139.843412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 159 00000100:00100000:1.0:1788651139.846553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.846604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389413376 00000100:00100000:2.0:1788651139.846616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389413376 00000100:00100000:2.0:1788651139.846676:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:2.0:1788651139.846689:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:11455:x1875536389413376:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651139.847177:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+48:11455:x1875536389413376:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 489us (630us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788651139.847186:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1788651139.905780:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651139.905873:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389413632 00000100:00100000:2.0:1788651139.905884:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389413632 00000100:00100000:2.0:1788651139.905997:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 160 00000100:00100000:2.0:1788651139.906021:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+48:11461:x1875536389413632:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651139.906046:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651139.906078:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2af expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.906207:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.906222:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 49 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.906231:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.906262:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 49 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.906274:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 49 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651139.906291:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408287360:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651139.906403:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd411f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651139.910628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651139.910688:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389413760 00000100:00100000:1.0:1788651139.910701:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389413760 00010000:00010000:1.0:1788651139.910742:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 50 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651139.910813:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:1.0:1788651139.910835:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:2355:x1875536389413760:12345-192.168.203.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788651139.910842:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408287360:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651139.910852:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651139.910868:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.910869:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 50 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.910894:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 50 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.910917:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2a1 expref: 50 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.910933:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:1.0:1788651139.910937:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.910959:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.910966:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.911016:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651139.911043:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.911061:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651139.911074:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:2355:x1875536389413760:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 250us (454us total) trans 0 rc 0/0 00000004:00200000:2.0:1788651139.911079:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1788651139.911084:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00010000:00010000:2.0:1788651139.911238:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 50 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.911253:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 49 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651139.911261:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651139.911264:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651139.911266:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:2.0:1788651139.911288:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:11461:x1875536389413632:12345-192.168.203.21@tcp:101:bash.0 Request processed in 5272us (5517us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788651139.911295:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 160 00000100:00100000:1.0:1788651139.914399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.914475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389414016 00000100:00100000:3.0:1788651139.914485:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389414016 00000100:00100000:3.0:1788651139.914549:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 161 00000100:00100000:3.0:1788651139.914559:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+49:11461:x1875536389414016:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:3.0:1788651139.914808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.914823:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.914848:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651139.914894:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788651139.914914:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002b6b9d9 reply state 00000000aa0285b5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651139.914923:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651139.914994:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11461:x1875536389414016:12345-192.168.203.21@tcp:36:bash.0 Request processed in 436us (604us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788651139.915000:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 161 00000020:00080000:3.0:1788651139.915004:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788651139.916725:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.916762:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.916768:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.916774:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651139.916778:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.916785:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.916799:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:0.0:1788651139.916802:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651139.916807:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.916812:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba887977d4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651139.922260:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651139.922466:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389414144 00000100:00100000:3.0:1788651139.922476:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389414144 00000100:00100000:3.0:1788651139.922622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:3.0:1788651139.922635:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:11461:x1875536389414144:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651139.922658:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651139.922678:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977d52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2b6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.922771:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.922783:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 52 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.922791:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.922838:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 52 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651139.922851:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 52 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651139.922866:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408287488:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651139.922944:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651139.925878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651139.926333:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d402d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408287488:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651139.926357:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651139.926906:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389414272 00000100:00100000:0.0:1788651139.926915:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389414272 00010000:00010000:0.0:1788651139.926954:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 53 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651139.927087:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:0.0:1788651139.927098:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:2356:x1875536389414272:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651139.927128:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651139.927148:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 53 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.927161:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 53 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.927182:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977d3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2af expref: 53 pid: 5871 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.927197:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:0.0:1788651139.927201:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.927211:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.927218:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651139.927244:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651139.927301:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:2356:x1875536389414272:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 206us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651139.927307:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00010000:00010000:1.0:1788651139.927359:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.927367:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651139.927406:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788651139.927411:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651139.927431:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.927460:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887977d52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2b6 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.927475:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2b6 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651139.927481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:1.0:1788651139.927490:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651139.927493:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c800, rc 0) 00000100:00100000:1.0:1788651139.927518:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:11461:x1875536389414144:12345-192.168.203.21@tcp:101:bash.0 Request processed in 4887us (5268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651139.927524:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:0.0:1788651139.930872:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651139.930937:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389414528 00000100:00100000:1.0:1788651139.930949:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389414528 00000100:00100000:1.0:1788651139.931011:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:1.0:1788651139.931022:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:11461:x1875536389414528:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:1.0:1788651139.931617:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11461:x1875536389414528:12345-192.168.203.21@tcp:35:bash.0 Request processed in 242us (399us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788651139.931628:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000004:00080000:3.0:1788651139.972619:0:7165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344032508643ns, next at 345032506166ns, rc = 0 00000100:00100000:2.0:1788651139.972679:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651139.972699:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408287616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651139.972784:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651139.973346:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408287616 00000100:00100000:3.0:1788651139.973356:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408287616 00000100:00100000:3.0:1788651139.973437:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651139.973448:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408287616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651139.973472:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651139.973532:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408287616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651139.973539:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651139.973757:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408287616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788651139.973955:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651140.008713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.008830:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389414784 00000100:00100000:1.0:1788651140.008841:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389414784 00000100:00100000:1.0:1788651140.008920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00100000:1.0:1788651140.008933:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11471:x1875536389414784:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651140.008956:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651140.008975:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651140.009054:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788651140.009200:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977d60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2bd expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.009214:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:1.0:1788651140.009216:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651140.009233:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2bd expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.009246:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c200, rc 0) 00000100:00100000:1.0:1788651140.009298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:11471:x1875536389414784:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 369us (595us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788651140.009305:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 163 00000100:00080000:3.0:1788651140.009407:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651140.012575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.012667:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389414912 00000100:00100000:2.0:1788651140.012679:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389414912 00000100:00100000:2.0:1788651140.012738:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:2.0:1788651140.012758:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:11471:x1875536389414912:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:2.0:1788651140.012834:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.012851:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.012879:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.012895:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.012902:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.012909:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.012994:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013016:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013024:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651140.013071:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013083:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013089:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013095:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013144:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.013149:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013158:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013170:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651140.013173:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.013178:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013184:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba887977d6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013198:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013204:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013210:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013215:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.013218:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013224:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013243:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be449aeb00) 00010000:00010000:2.0:1788651140.013245:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.013248:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013254:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013267:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013273:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013279:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013284:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.013287:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013292:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013299:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651140.013301:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.013303:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.013309:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977d7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651140.013392:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:11471:x1875536389414912:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 644us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651140.013400:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:0.0:1788651140.017263:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.023307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389415168 00000100:00100000:2.0:1788651140.023322:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389415168 00000100:00100000:2.0:1788651140.024996:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:2.0:1788651140.025027:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+53:11471:x1875536389415168:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651140.025394:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:11471:x1875536389415168:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 377us (8396us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788651140.025402:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1788651140.059943:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.060158:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.060214:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.060263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.060293:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389415680 00000100:00100000:3.0:1788651140.060303:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389415680 00000100:00080000:3.0:1788651140.060329:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651140.060455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389415296 00000100:00100000:0.0:1788651140.060460:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389415296 00000100:00100000:0.0:1788651140.060504:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 287 00000100:00100000:0.0:1788651140.060515:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389415296:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651140.060604:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389415296:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 90us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651140.060612:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 287 00000100:00100000:3.0:1788651140.061083:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 139 00000100:00100000:3.0:1788651140.061093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389415680:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651140.061158:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389415552 00000100:00100000:3.0:1788651140.061159:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389415680:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 67us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651140.061165:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389415552 00000100:00100000:3.0:1788651140.061170:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 139 00000100:00100000:2.0:1788651140.061206:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389415424 00000100:00100000:2.0:1788651140.061209:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389415424 00000100:00100000:2.0:1788651140.061229:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:2.0:1788651140.061236:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389415552:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651140.061265:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2354:x1875536389415552:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 30us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651140.061271:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:2.0:1788651140.061282:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:2.0:1788651140.061289:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2354:x1875536389415424:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651140.061311:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2354:x1875536389415424:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 23us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651140.061317:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00080000:2.0:1788651140.061350:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651140.061354:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651140.089941:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.093820:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389415936 00000100:00100000:2.0:1788651140.093836:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389415936 00000100:00100000:3.0:1788651140.095255:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:3.0:1788651140.095270:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:11474:x1875536389415936:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651140.095294:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651140.095315:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2c4 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095401:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095416:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095428:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095442:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095448:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095469:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095599:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095609:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095628:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651140.095638:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788651140.095742:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095759:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095765:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095771:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651140.095775:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095784:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095795:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651140.095798:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651140.095809:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095815:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977d8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095829:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095836:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095842:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095847:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651140.095850:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095855:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095862:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be51759f00) 00010000:00010000:3.0:1788651140.095864:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651140.095868:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095874:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977d91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095913:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2c4 expref: 57 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095939:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2c4 expref: 56 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.095947:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:3.0:1788651140.095949:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651140.095951:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d200, rc 0) 00000100:00100000:3.0:1788651140.096023:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11474:x1875536389415936:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 756us (6091us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788651140.096030:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:3.0:1788651140.103209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651140.103645:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389416064 00000100:00100000:0.0:1788651140.103655:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389416064 00000100:00100000:0.0:1788651140.103723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:0.0:1788651140.103735:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11474:x1875536389416064:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:0.0:1788651140.103813:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103831:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103842:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103868:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103875:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103883:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103889:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651140.103893:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103901:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103927:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:0.0:1788651140.103930:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651140.103935:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.103941:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651140.104013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11474:x1875536389416064:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 280us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651140.104021:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:3.0:1788651140.104353:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.105193:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389416192 00000100:00100000:1.0:1788651140.105204:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389416192 00000100:00100000:1.0:1788651140.105253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1788651140.105262:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:2356:x1875536389416192:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651140.105277:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651140.105296:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887977d98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2c4 expref: 56 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.105312:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:1.0:1788651140.105316:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651140.105350:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:2356:x1875536389416192:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 89us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651140.105357:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1788651140.113870:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.113972:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389416448 00000100:00100000:1.0:1788651140.113984:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389416448 00000100:00100000:1.0:1788651140.114083:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1788651140.114094:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:11474:x1875536389416448:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651140.114391:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11474:x1875536389416448:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 297us (529us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788651140.114399:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:0.0:1788651140.351517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.351611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389416704 00000100:00100000:1.0:1788651140.351624:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389416704 00000100:00100000:1.0:1788651140.351687:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:1.0:1788651140.351699:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11492:x1875536389416704:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:1.0:1788651140.351724:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651140.351753:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.351851:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977db4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.351865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977db4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.351877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977db4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651140.351887:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788651140.352017:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2cb expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.352037:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977db4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2cb expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.352047:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:1.0:1788651140.352050:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788651140.352054:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c400, rc 0) 00000100:00100000:1.0:1788651140.352473:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11492:x1875536389416704:12345-192.168.203.21@tcp:101:cat.0 Request processed in 775us (962us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788651140.352498:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:3.0:1788651140.387830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651140.387996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389416832 00000100:00100000:0.0:1788651140.388006:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389416832 00000100:00100000:0.0:1788651140.388076:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:0.0:1788651140.388087:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11493:x1875536389416832:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651140.388297:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651140.388319:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.388381:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.388393:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.388405:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651140.388455:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788651140.388458:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651140.388475:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.388501:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d2 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.388518:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d2 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.388526:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651140.388732:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651140.388737:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860400, rc 0) 00000100:00100000:0.0:1788651140.388878:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11493:x1875536389416832:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 791us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651140.388886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:3.0:1788651140.402739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.402900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389417216 00000100:00100000:2.0:1788651140.402911:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389417216 00000100:00100000:2.0:1788651140.402968:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:2.0:1788651140.402979:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11493:x1875536389417216:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651140.403789:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11493:x1875536389417216:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 807us (1054us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788651140.403799:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:2.0:1788651140.410035:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.410147:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389417344 00000100:00100000:1.0:1788651140.410159:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389417344 00000100:00100000:1.0:1788651140.410228:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1788651140.410249:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11493:x1875536389417344:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:1.0:1788651140.410268:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788651140.410291:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba887977d59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2b6 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.410314:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977db4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2cb expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.410327:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887977c64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c277 expref: 58 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.410336:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aef00) 00010000:00010000:1.0:1788651140.410346:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651140.410522:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11493:x1875536389417344:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 284us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651140.410537:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1788651140.413868:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.414092:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389417472 00000100:00100000:2.0:1788651140.414103:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389417472 00000100:00100000:2.0:1788651140.414440:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:2.0:1788651140.414451:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11493:x1875536389417472:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:2.0:1788651140.414730:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.414755:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.414766:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651140.414955:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788651140.415309:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11493:x1875536389417472:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 857us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651140.415318:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 169 00010000:00010000:2.0:1788651140.420761:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651140.436766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.436921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389417600 00000100:00100000:1.0:1788651140.436933:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389417600 00000100:00100000:1.0:1788651140.437520:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:1.0:1788651140.437622:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11495:x1875536389417600:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651140.437644:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651140.437665:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2d9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437753:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437768:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437779:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437795:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437802:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437808:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437890:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437899:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.437906:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651140.437939:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788651140.437943:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651140.438431:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438454:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438463:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438469:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438476:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438481:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651140.438485:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438492:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438505:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:1.0:1788651140.438508:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651140.438513:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438520:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba887977dde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438590:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438597:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438609:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438615:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651140.438618:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438625:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438633:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be58f79600) 00010000:00010000:1.0:1788651140.438635:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651140.438638:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438643:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438678:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887977dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438693:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651140.438699:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:1.0:1788651140.438701:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651140.438704:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c200, rc 0) 00000100:00100000:1.0:1788651140.439189:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11495:x1875536389417600:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1658us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651140.439208:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 170 00000040:00080000:2.0:1788651140.933503:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651140.933521:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651140.933685:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788651140.933690:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651140.933995:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408287744:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788651140.934091:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be43ee1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788651140.948627:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408287744:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651140.948968:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.949029:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389417728 00000100:00100000:3.0:1788651140.949036:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389417728 00000100:00100000:3.0:1788651140.949090:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:3.0:1788651140.949099:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11506:x1875536389417728:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651140.949150:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651140.949245:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11506:x1875536389417728:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 146us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651140.949253:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:1.0:1788651140.953727:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.954057:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389417856 00000100:00100000:2.0:1788651140.954069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389417856 00000100:00100000:2.0:1788651140.954206:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:2.0:1788651140.954218:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11506:x1875536389417856:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788651140.954304:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954322:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954338:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954354:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954361:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954368:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954395:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954431:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954438:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651140.954484:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788651140.954489:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651140.954502:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954522:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954529:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954535:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954540:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.954544:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954551:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954562:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:2.0:1788651140.954565:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.954570:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954594:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977df3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954606:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954611:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954616:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954621:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618aa00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.954624:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954631:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954639:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93be449aef00) 00010000:00010000:2.0:1788651140.954642:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.954645:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954651:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977dfa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954663:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954668:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954679:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954683:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.954686:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954691:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954708:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:2.0:1788651140.954711:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.954713:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.954725:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651140.954812:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11506:x1875536389417856:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 596us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651140.954821:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:1.0:1788651140.958976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.959220:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389418112 00000100:00100000:3.0:1788651140.959242:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389418112 00000100:00100000:3.0:1788651140.959339:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:3.0:1788651140.959351:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11506:x1875536389418112:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651140.959372:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651140.959390:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2e0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959480:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959495:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959506:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651140.959516:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788651140.959618:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959626:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959634:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959643:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651140.959648:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959656:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:3.0:1788651140.959678:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651140.959683:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959690:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959724:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e08 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2e0 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959732:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:3.0:1788651140.959734:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651140.959750:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2e0 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.959759:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ce00, rc 0) 00000100:00100000:3.0:1788651140.959816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11506:x1875536389418112:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 468us (850us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788651140.959823:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:3.0:1788651140.961705:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651140.961773:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389418240 00000100:00100000:1.0:1788651140.961784:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389418240 00000100:00100000:1.0:1788651140.961878:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:1.0:1788651140.961889:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11506:x1875536389418240:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788651140.961919:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788651140.962014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11506:x1875536389418240:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 127us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651140.962022:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:1.0:1788651140.965315:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.965373:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389418496 00000100:00100000:2.0:1788651140.965382:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389418496 00000100:00100000:2.0:1788651140.965428:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 175 00000100:00100000:2.0:1788651140.965435:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11506:x1875536389418496:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651140.965453:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651140.965455:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651140.965474:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d2 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.965502:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651140.965506:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651140.965516:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2e7 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651140.965922:0:5871:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788651140.966074:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.966086:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.966093:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.966177:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887977e1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2e7 expref: 61 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.966192:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2e7 expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.966199:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651140.966201:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651140.966204:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618aa00, rc 0) 00000100:00100000:2.0:1788651140.966292:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11506:x1875536389418496:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 856us (983us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788651140.966298:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 175 00000100:00100000:3.0:1788651140.968812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.969453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389418752 00000100:00100000:2.0:1788651140.969464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389418752 00000100:00100000:2.0:1788651140.969526:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 176 00000100:00100000:2.0:1788651140.969537:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11506:x1875536389418752:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788651140.969605:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651140.969633:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2e7 expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969652:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be449aef00) 00010000:00010000:2.0:1788651140.969664:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651140.969687:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969700:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969710:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969724:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969730:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969746:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969805:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969827:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969833:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969839:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.969843:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969850:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969858:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651140.969860:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.969864:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969869:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977e32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969877:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969882:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969887:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969891:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651140.969899:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969904:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969910:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5cf697 (ffff93be449ae100) 00010000:00010000:2.0:1788651140.969912:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651140.969914:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651140.969919:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977e39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5cf697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651140.970022:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11506:x1875536389418752:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 485us (1217us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788651140.970029:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 176 00000100:00100000:1.0:1788651140.973517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.973661:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389418880 00000100:00100000:3.0:1788651140.973674:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389418880 00000100:00100000:3.0:1788651140.973826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 177 00000100:00100000:3.0:1788651140.973839:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11506:x1875536389418880:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651140.973870:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651140.973905:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.973939:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.973952:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.973964:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.974148:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.974166:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.974174:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:3.0:1788651140.974177:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651140.974180:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d600, rc 0) 00000100:00100000:3.0:1788651140.974290:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11506:x1875536389418880:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 452us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651140.974297:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 177 00000100:00100000:1.0:1788651140.981460:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651140.981608:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389419136 00000100:00100000:0.0:1788651140.981619:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389419136 00000100:00100000:0.0:1788651140.981802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 178 00000100:00100000:0.0:1788651140.981816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11506:x1875536389419136:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651140.981903:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.981920:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651140.981944:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651140.982220:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788651140.982230:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345042122204ns, next at 346042119501ns, rc = 0 00000004:00010000:0.0:1788651140.982315:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b4a284e reply state 00000000b1714081 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651140.982324:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651140.982465:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11506:x1875536389419136:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 651us (1014us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788651140.982473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 178 00010000:00010000:3.0:1788651140.984851:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.984868:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.984876:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.984897:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651140.984902:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.984910:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.984924:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:3.0:1788651140.984927:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788651140.984932:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.984938:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977e4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651140.985859:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.985982:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389419264 00000100:00100000:3.0:1788651140.985994:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389419264 00000100:00100000:3.0:1788651140.986045:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 179 00000100:00100000:3.0:1788651140.986055:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11506:x1875536389419264:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651140.986080:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651140.986098:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2f5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.986192:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.986206:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651140.986242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:3.0:1788651140.986245:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651140.986248:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ce00, rc 0) 00000100:00100000:3.0:1788651140.986310:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11506:x1875536389419264:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 257us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651140.986318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 179 00000100:00100000:1.0:1788651140.988369:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651140.988508:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389419392 00000100:00100000:2.0:1788651140.988518:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389419392 00000100:00100000:2.0:1788651140.988573:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:2.0:1788651140.988582:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389419392:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788651140.988994:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389419392:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 411us (631us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788651140.989002:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:1.0:1788651140.999272:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651140.999374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389419648 00000100:00100000:3.0:1788651140.999385:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389419648 00000100:00100000:3.0:1788651140.999480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1788651140.999492:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11506:x1875536389419648:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651140.999716:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+63:11506:x1875536389419648:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 226us (450us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788651140.999724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:0.0:1788651141.002304:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651141.002384:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389419904 00000100:00100000:1.0:1788651141.002395:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389419904 00000100:00100000:1.0:1788651141.002479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 180 00000100:00100000:1.0:1788651141.002489:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+63:11506:x1875536389419904:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788651141.002602:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+63:11506:x1875536389419904:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 114us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651141.002610:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 180 00000100:00100000:0.0:1788651141.005780:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651141.006383:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420032 00000100:00100000:1.0:1788651141.006395:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420032 00000100:00100000:1.0:1788651141.006460:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 181 00000100:00100000:1.0:1788651141.006471:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+63:11506:x1875536389420032:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651141.006502:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651141.006523:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977e5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c2fc expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.006592:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.006607:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.006619:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651141.006653:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651141.006672:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.006698:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887977e5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2fc expref: 65 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.006714:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2fc expref: 64 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.006722:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:1.0:1788651141.006724:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788651141.006728:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:1.0:1788651141.006849:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11506:x1875536389420032:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 379us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651141.006856:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 181 00000100:00100000:3.0:1788651141.009893:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651141.010035:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420160 00000100:00100000:2.0:1788651141.010047:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420160 00000100:00100000:2.0:1788651141.010132:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1788651141.010145:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389420160:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651141.010171:0:10263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651141.010191:0:10263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c303 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651141.010215:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca685, blocks: 0x1 00010000:00010000:2.0:1788651141.010233:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788651141.010238:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651141.010247:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 8 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.010265:0:10263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 8 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.010279:0:10263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ba00, rc 0) 00000100:00100000:2.0:1788651141.010333:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389420160:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 192us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651141.010340:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:0.0:1788651141.013469:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651141.013578:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420416 00000100:00100000:3.0:1788651141.013588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420416 00000100:00100000:3.0:1788651141.013644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 182 00000100:00100000:3.0:1788651141.013655:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11506:x1875536389420416:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651141.013767:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11506:x1875536389420416:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651141.013775:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 182 00000100:00100000:3.0:1788651141.016364:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651141.016440:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420544 00000100:00100000:0.0:1788651141.016451:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420544 00000100:00100000:0.0:1788651141.016509:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1788651141.016520:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:11506:x1875536389420544:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651141.016539:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651141.016556:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c30a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.016588:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 9 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.016597:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651141.016607:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651141.016613:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.016647:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 9 pid: 10263 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.016661:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 9 pid: 10263 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.016675:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1875536408287872:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651141.016766:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651141.021207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651141.021285:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420672 00000100:00100000:0.0:1788651141.021295:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420672 00010000:00010000:0.0:1788651141.021337:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 10 pid: 10263 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.021386:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:0.0:1788651141.021399:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:2356:x1875536389420672:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651141.021414:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651141.021436:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 10 pid: 10263 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.021451:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 10 pid: 10263 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.021493:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651141.021497:0:11151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651141.021506:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.021516:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.021565:0:11151:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.021581:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11151:1875536408288000:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651141.021661:0:11151:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b993c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788651141.021789:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977e6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c303 expref: 10 pid: 10263 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.021804:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1875536408287872:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651141.021826:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.021837:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860a00, rc 0) 00000100:00100000:0.0:1788651141.021869:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:11506:x1875536389420544:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 5351us (5513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651141.021877:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1788651141.025206:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a7b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11151:1875536408288000:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651141.025235:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651141.025297:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389420672:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 3901us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651141.025307:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:0.0:1788651141.027801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651141.027885:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420800 00000100:00100000:2.0:1788651141.027897:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420800 00002000:00100000:2.0:1788651141.027955:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93be45a7b100 x1875536389420800/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:282/0 lens 504/0 e 0 to 0 dl 1788651152 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651141.027967:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be45a7b100 with x1875536389420800 ext(0->8) 00002000:00010000:2.0:1788651141.027973:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be45a7b100 00000100:00100000:2.0:1788651141.028080:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:2.0:1788651141.028091:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389420800:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788651141.028800:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:2355:x1875536389420800:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 708us (1004us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788651141.028810:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00002000:00100000:2.0:1788651141.028818:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93be45a7b100 x1875536389420800/t4294967314(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:282/0 lens 504/448 e 0 to 0 dl 1788651152 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651141.028828:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be45a7b100 with x1875536389420800 ext(0->8) 00002000:00010000:2.0:1788651141.028832:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be45a7b100 00000100:00100000:3.0:1788651141.032034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651141.032476:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389420928 00000100:00100000:1.0:1788651141.032487:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389420928 00000100:00100000:0.0:1788651141.032693:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 183 00000100:00100000:0.0:1788651141.032705:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11506:x1875536389420928:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788651141.059758:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1788651141.059770:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788651141.059788:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788651141.059806:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be65b99840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788651141.059810:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be75871d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93be65b99480 00000020:00080000:1.0:1788651141.059814:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be75871b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be7ba7d400 00000100:00100000:2.0:1788651141.059867:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+45:11506:x1875536389420928:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 27157us (27833us total) trans 0 rc 0/0 00000020:00080000:0.0:1788651141.059880:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1788651141.059881:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 183 00000001:00080000:1.0:1788651141.059887:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788651141.059900:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788651141.060785:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408288128:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788651141.060810:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788651141.060828:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408288256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788651141.060846:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651141.060901:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651141.060934:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408288128 00000100:00100000:1.0:1788651141.060943:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408288128 00000100:00080000:0.0:1788651141.060980:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651141.061001:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408288256 00000100:00100000:1.0:1788651141.061006:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408288256 00000100:00080000:0.0:1788651141.061031:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651141.061047:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651141.061057:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788651141.061062:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408288128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788651141.061071:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875536408288256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788651141.061091:0:10263:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788651141.061220:0:10263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ca683, atime: 0x6a9ca683, ctime: 0x6a9ca683, blocks: 0x1 00010000:00010000:2.0:1788651141.061230:0:10263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061245:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=345s v=(0 0) 00002000:00010000:1.0:1788651141.061245:0:6675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788651141.061252:0:6675:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788651141 00010000:00010000:2.0:1788651141.061254:0:10263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1788651141.061257:0:6675:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788651141.061262:0:6675:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788651141 -> 1788651141 00010000:00010000:2.0:1788651141.061263:0:10263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651141.061265:0:6675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1788651141.061283:0:10263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061303:0:10263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061311:0:10263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651141.061327:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408288128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 270us (482us total) trans 4294967315 rc 0/0 00010000:00010000:2.0:1788651141.061329:0:10263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651141.061342:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:0.0:1788651141.061436:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be45a79f80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788651141.061443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408288128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788651141.061889:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875536408288256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 821us (988us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788651141.061897:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1788651141.061918:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651141.061923:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061930:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651141.061933:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061940:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061953:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.061958:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba887977e78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651141.061964:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be42e3f100/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788651141.061975:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408288256:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788651141.061984:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651141.061987:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651141.061988:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651141.062304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651141.062386:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389421056 00000100:00100000:1.0:1788651141.062392:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389421056 00000100:00100000:1.0:1788651141.062466:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:1.0:1788651141.062476:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:2356:x1875536389421056:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000040:00080000:0.0:1788651141.097762:0:12442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651141.097771:0:12442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651141.097811:0:12442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788651141.097816:0:12442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788651141.101387:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1788651141.101406:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1788651141.102277:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389421056:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 39798us (39969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651141.102290:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:2.0:1788651141.108425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651141.108587:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389421312 00000100:00100000:3.0:1788651141.108598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389421312 00000100:00100000:3.0:1788651141.108654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 184 00000100:00100000:3.0:1788651141.108666:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:11506:x1875536389421312:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651141.108724:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651141.108760:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2fc expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.108777:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:3.0:1788651141.108783:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651141.108810:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.108824:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.108834:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651141.109088:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000389b3df reply state 00000000f1cb70b6 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651141.109097:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651141.109215:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11506:x1875536389421312:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 551us (796us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788651141.109224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 184 00010000:00010000:1.0:1788651141.120828:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.120846:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.120854:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.120860:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651141.120864:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.120871:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.120887:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:1.0:1788651141.120890:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651141.120894:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.120901:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887977e7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651141.121808:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651141.122026:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389421440 00000100:00100000:1.0:1788651141.122054:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389421440 00000100:00100000:1.0:1788651141.122173:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:1.0:1788651141.122185:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389421440:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788651141.122463:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788651141.122467:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788651141 -> 1788651140 00002000:00010000:1.0:1788651141.122469:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788651139 00002000:00010000:1.0:1788651141.122471:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788651141 -> 1788651140 00002000:00010000:1.0:1788651141.122473:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788651141.122637:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389421440:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 454us (834us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788651141.122645:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:1.0:1788651141.130730:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651141.133247:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389421696 00000100:00100000:3.0:1788651141.133262:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389421696 00000100:00100000:0.0:1788651141.133427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 185 00000100:00100000:0.0:1788651141.133441:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:11506:x1875536389421696:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788651141.133526:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.133544:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.133554:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.133603:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.133618:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 18 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.133632:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408288384:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651141.134033:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99300 going to sleep for 11 seconds 00000100:00100000:1.0:1788651141.155216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651141.155242:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875536408288384:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651141.155269:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651141.155290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389421824 00000100:00100000:2.0:1788651141.155297:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389421824 00010000:00010000:2.0:1788651141.155335:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651141.155373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:2.0:1788651141.155383:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:2356:x1875536389421824:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651141.155396:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651141.155402:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.155413:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.155436:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba887977e47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2ee expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.155450:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:2.0:1788651141.155461:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.155470:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.155477:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.155507:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651141.155561:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:2356:x1875536389421824:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 179us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651141.155568:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00010000:00010000:1.0:1788651141.155754:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155762:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155790:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155798:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155803:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155809:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651141.155813:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155827:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155836:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:1.0:1788651141.155839:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788651141.155842:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.155848:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977e86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651141.155898:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:11506:x1875536389421696:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 22461us (25179us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788651141.155907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 185 00000100:00100000:1.0:1788651141.159708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651141.159816:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389421952 00000100:00100000:0.0:1788651141.159829:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389421952 00000100:00100000:0.0:1788651141.159922:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:0.0:1788651141.159936:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389421952:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788651141.159999:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.160032:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.160040:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651141.160044:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651141.160049:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.160087:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.160100:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 8 pid: 6674 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.160143:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408288512:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651141.160223:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99300 going to sleep for 11 seconds 00000100:00100000:0.0:1788651141.163859:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651141.163935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389422080 00000100:00100000:2.0:1788651141.163945:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389422080 00010000:00010000:2.0:1788651141.164008:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 9 pid: 6674 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651141.164054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:2.0:1788651141.164066:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2354:x1875536389422080:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651141.164082:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651141.164104:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 9 pid: 6674 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.164156:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 9 pid: 6674 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.164181:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651141.164185:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651141.164198:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.164208:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.164230:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651141.164281:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2354:x1875536389422080:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 218us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651141.164289:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00010000:00010000:1.0:1788651141.165618:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d0bedc/0x84a2fba887977e71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c30a expref: 8 pid: 6674 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651141.165635:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408288512:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651141.165657:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165667:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165674:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165710:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165719:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165727:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165733:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651141.165750:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165758:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165771:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.165778:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a3cf51/0x84a2fba887977e8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651141.165835:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389421952:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 5903us (6138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651141.165844:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:1.0:1788651141.168796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651141.168938:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389422336 00000100:00100000:0.0:1788651141.168948:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389422336 00000100:00100000:0.0:1788651141.169010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 186 00000100:00100000:0.0:1788651141.169022:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+17:11506:x1875536389422336:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788651141.169103:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169146:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169165:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169366:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169375:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169381:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169407:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.169416:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 18 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.169427:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408288640:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651141.169499:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651141.174923:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651141.174953:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389422464 00000100:00100000:0.0:1788651141.174964:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389422464 00010000:00010000:0.0:1788651141.175008:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.175049:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:0.0:1788651141.175059:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:2355:x1875536389422464:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651141.175075:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651141.175090:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.175104:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651141.175136:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408288640:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651141.175212:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.176481:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887977e55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2f5 expref: 19 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.176499:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:0.0:1788651141.176504:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.176514:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.176523:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.176554:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651141.176618:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:2355:x1875536389422464:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1559us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651141.176627:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00010000:00010000:1.0:1788651141.176813:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.176821:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651141.176998:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788651141.177394:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788651141.177441:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788651141.177527:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875536408288768:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788651141.177593:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651141.177633:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788651141.177693:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408288768 00000100:00100000:0.0:1788651141.177700:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408288768 00000100:00100000:0.0:1788651141.177757:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651141.177766:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875536408288768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788651141.177837:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875536408288768:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651141.177853:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651141.177891:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788651141.177897:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be45a79f80, transno 4294967315 00000100:00100000:0.0:1788651141.177909:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875536408288768:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788651141.178452:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788651141.178508:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875536408288896:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788651141.178552:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651141.178572:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651141.178775:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408288896 00000100:00100000:0.0:1788651141.178781:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408288896 00000100:00100000:0.0:1788651141.178805:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651141.178813:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875536408288896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788651141.178957:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875536408288896:12345-0@lo:1000:mdt00_000.0 Request processed in 145us (403us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788651141.178964:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651141.179000:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875536408288896:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788651141.179031:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.179040:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.179048:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.179055:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651141.179059:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.179075:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.179090:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be51759f00) 00010000:00010000:0.0:1788651141.179093:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651141.179098:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.179105:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977e9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181265:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181274:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181281:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181287:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651141.181291:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181299:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181313:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:0.0:1788651141.181316:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651141.181321:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181338:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a400/0x84a2fba887977dd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181362:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181376:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181386:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181424:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651141.181440:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 21 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651141.181454:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408289024:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651141.181547:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651141.185600:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408289024:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651141.185632:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651141.194614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651141.194959:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389422592 00000100:00100000:1.0:1788651141.194971:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389422592 00010000:00010000:1.0:1788651141.195016:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 22 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651141.195060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:1.0:1788651141.195072:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:2353:x1875536389422592:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651141.195090:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651141.195097:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 22 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.195285:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 22 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.195309:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887977dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c2d9 expref: 22 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.195335:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:1.0:1788651141.195340:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.195350:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.195357:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.195379:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651141.195434:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:2353:x1875536389422592:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 364us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651141.195441:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00010000:00010000:3.0:1788651141.195494:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195502:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195514:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195521:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195538:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195544:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651141.195548:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195556:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195566:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:3.0:1788651141.195569:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651141.195573:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195579:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977ea2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195591:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195609:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195615:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195621:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651141.195624:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195630:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195639:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449aeb00) 00010000:00010000:3.0:1788651141.195641:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651141.195645:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651141.195650:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977e94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651141.195863:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11506:x1875536389422336:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 26842us (27074us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788651141.195872:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 186 00000020:00080000:3.0:1788651141.195875:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788651141.196301:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651141.196305:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651141.197475:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788651141.197486:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651141.209473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651141.209555:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389422848 00000100:00100000:3.0:1788651141.209566:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389422848 00000100:00100000:3.0:1788651141.209630:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:3.0:1788651141.209641:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57badc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11506:x1875536389422848:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788651141.210657:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788651141.210781:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788651141.210832:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.210849:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.210861:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.210881:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.210888:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.210894:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651141.210915:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651141.211012:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57badc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:11506:x1875536389422848:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 1371us (1545us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788651141.211021:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000020:00080000:1.0:1788651141.211026:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788651141.211288:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651141.211296:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.211302:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651141.211306:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.211315:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.211336:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93be58f79100) 00010000:00010000:2.0:1788651141.211339:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788651141.211344:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.211350:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba887977ea9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651141.211367:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651141.211368:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651141.211370:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651141.450517:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788651142.064397:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788651142.064417:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:2.0:1788651142.468745:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651143.046488:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408289280:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.046585:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651143.046643:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408289792:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.046671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651143.046707:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788651143.046712:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408289152:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.046753:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651143.046785:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408289664:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.046809:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651143.046836:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408289408:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.046859:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651143.046876:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651143.046881:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408289536:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.046904:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651143.046942:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408289792 00000100:00100000:0.0:1788651143.046951:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408289792 00000100:00100000:0.0:1788651143.047015:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408289536 00000100:00100000:0.0:1788651143.047019:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408289536 00000100:00100000:0.0:1788651143.047045:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788651143.047055:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875536408289792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.047142:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875536408289792:12345-0@lo:400:kworker.0 Request processed in 89us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651143.047151:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788651143.047169:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788651143.047176:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408289536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651143.047556:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408289280 00000100:00100000:3.0:1788651143.047563:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408289280 00000100:00100000:3.0:1788651143.047596:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408289664 00000100:00100000:3.0:1788651143.047599:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408289664 00000100:00100000:3.0:1788651143.047612:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408289408 00000100:00100000:3.0:1788651143.047614:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408289408 00000100:00100000:3.0:1788651143.047627:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788651143.047633:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651143.047672:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408289280:12345-0@lo:400:kworker.0 Request processed in 40us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.047678:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788651143.047691:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788651143.047697:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408289664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651143.047732:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408289664:12345-0@lo:400:kworker.0 Request processed in 26us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.047740:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788651143.047752:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788651143.047757:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651143.047793:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408289408:12345-0@lo:400:kworker.0 Request processed in 37us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.047799:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788651143.047849:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408289408:0@lo:400:kworker.0 00000100:00100000:3.0:1788651143.047928:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408289152 00000100:00100000:3.0:1788651143.047932:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408289152 00000100:00100000:3.0:1788651143.047962:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788651143.047969:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408289152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651143.048015:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408289152:12345-0@lo:400:kworker.0 Request processed in 46us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.048021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:3.0:1788651143.048063:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651143.048068:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651143.048070:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651143.048785:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408289536:12345-0@lo:400:kworker.0 Request processed in 1605us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651143.048797:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788651143.048842:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788651143.048849:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788651143.048872:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be42e3f100, transno 4294967307 00000100:00100000:0.0:1788651143.048888:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408289536:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.048922:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408289152:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.048947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408289664:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.048960:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408289280:0@lo:400:kworker.0 00000100:00100000:0.0:1788651143.048972:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408289792:0@lo:400:kworker.0 00000040:00080000:3.0:1788651143.112230:0:12493:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651143.112239:0:12493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651143.112280:0:12493:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788651143.112359:0:12493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651143.293083:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651143.296253:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389423104 00000100:00100000:1.0:1788651143.296275:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389423104 00000100:00100000:0.0:1788651143.300242:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 187 00000100:00100000:0.0:1788651143.300260:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:11524:x1875536389423104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651143.300292:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788651143.300442:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788651143.300516:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977eb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c311 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.300648:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977eb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.300667:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.300684:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651143.300699:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788651143.300943:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977eb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c311 expref: 25 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.300965:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c311 expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.300976:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651143.300994:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651143.300999:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860000, rc 0) 00000100:00100000:0.0:1788651143.301099:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11524:x1875536389423104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 842us (8030us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788651143.301134:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 187 00000100:00100000:1.0:1788651143.313373:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.319854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389423232 00000100:00100000:2.0:1788651143.319877:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389423232 00000100:00100000:2.0:1788651143.320003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 188 00000100:00100000:2.0:1788651143.320017:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11524:x1875536389423232:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:2.0:1788651143.320139:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320161:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320177:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320209:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320220:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320238:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320544:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320561:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651143.320613:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320629:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320635:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320642:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320648:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618aa00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651143.320653:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320661:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320675:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651143.320684:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651143.320691:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320698:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba887977ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320711:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320734:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320741:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320746:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651143.320749:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320756:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320764:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be449ae000) 00010000:00010000:2.0:1788651143.320766:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651143.320769:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320774:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320790:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320802:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320808:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320813:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651143.320816:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320823:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320830:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be449ae500) 00010000:00010000:2.0:1788651143.320832:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651143.320836:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.320841:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba887977ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651143.320954:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11524:x1875536389423232:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 937us (7656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651143.320963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 188 00000100:00100000:3.0:1788651143.404218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651143.404556:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389423488 00000100:00100000:3.0:1788651143.404568:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389423488 00000100:00100000:3.0:1788651143.404803:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 189 00000100:00100000:3.0:1788651143.405365:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11527:x1875536389423488:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651143.405396:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651143.405516:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977eda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c318 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.405693:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.405713:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.405737:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.405776:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.405784:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.405791:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406240:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406250:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406258:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651143.406338:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788651143.406747:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406756:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406763:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406770:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.406775:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406799:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.406815:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651143.407050:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651143.407058:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977ee1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407084:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407091:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407098:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407102:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.407137:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407146:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407155:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be51759d00) 00010000:00010000:3.0:1788651143.407158:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651143.407160:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407178:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977ee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407239:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977eda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407255:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.407264:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:3.0:1788651143.407266:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651143.407269:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d000, rc 0) 00000100:00100000:3.0:1788651143.407570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11527:x1875536389423488:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 2754us (3374us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788651143.407581:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 189 00000100:00100000:3.0:1788651143.418813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651143.422951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389423616 00000100:00100000:1.0:1788651143.422973:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389423616 00000100:00100000:1.0:1788651143.423065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 190 00000100:00100000:1.0:1788651143.423079:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11527:x1875536389423616:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1788651143.423189:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423375:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423414:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423451:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423459:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423467:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423473:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651143.423478:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423487:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423501:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:1.0:1788651143.423504:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651143.423510:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.423516:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887977efd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651143.423660:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11527:x1875536389423616:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 583us (4862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651143.423670:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 190 00000100:00100000:1.0:1788651143.443091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.443438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389423872 00000100:00100000:2.0:1788651143.443454:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389423872 00000100:00100000:2.0:1788651143.443524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1788651143.443542:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11527:x1875536389423872:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651143.443872:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:11527:x1875536389423872:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 335us (795us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788651143.446067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1788651143.480571:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651143.480704:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389424128 00000100:00100000:0.0:1788651143.480715:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389424128 00000100:00100000:0.0:1788651143.480800:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 191 00000100:00100000:0.0:1788651143.480812:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:11054:x1875536389424128:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1788651143.480843:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651143.480871:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c31f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.481003:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.481022:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.481044:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.481085:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.481100:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 28 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.481170:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408289920:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651143.481647:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651143.491097:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.491251:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408289920:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651143.491286:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.494489:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651143.497190:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389424256 00000100:00100000:1.0:1788651143.497209:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389424256 00010000:00010000:0.0:1788651143.497539:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 29 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.497598:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:0.0:1788651143.497609:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:2355:x1875536389424256:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651143.497628:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651143.497636:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 29 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.497650:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 29 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.497677:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977eef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c318 expref: 29 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.497698:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:0.0:1788651143.497705:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.497716:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.497734:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.497778:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651143.497871:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.497881:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:2355:x1875536389424256:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 271us (6799us total) trans 0 rc 0/0 00010000:00010000:1.0:1788651143.497884:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.497896:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00000004:00200000:1.0:1788651143.497914:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788651143.498371:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 29 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.498390:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 28 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.498398:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:0.0:1788651143.498401:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651143.498404:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860e00, rc 0) 00000100:00100000:0.0:1788651143.498450:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:11054:x1875536389424128:12345-192.168.203.21@tcp:101:bash.0 Request processed in 17640us (17893us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788651143.498458:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 191 00000100:00100000:0.0:1788651143.504306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.504708:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389424512 00000100:00100000:2.0:1788651143.504734:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389424512 00000100:00100000:2.0:1788651143.504799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 192 00000100:00100000:2.0:1788651143.504812:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:11054:x1875536389424512:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:2.0:1788651143.505212:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.505235:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.505251:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651143.505316:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788651143.505343:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054890fcf reply state 0000000059265327 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651143.505353:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788651143.506585:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788651143.506789:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11054:x1875536389424512:12345-192.168.203.21@tcp:36:bash.0 Request processed in 1973us (2492us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788651143.506799:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 192 00000020:00080000:2.0:1788651143.506824:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788651143.508483:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.508502:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.508515:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.508522:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651143.508528:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.508537:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.508557:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:2.0:1788651143.508562:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651143.508568:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.508575:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887977f19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.512835:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651143.515163:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389424640 00000100:00100000:3.0:1788651143.515184:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389424640 00000100:00100000:3.0:1788651143.515273:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:3.0:1788651143.515287:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:11054:x1875536389424640:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651143.515317:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651143.515346:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c326 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.515429:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c326 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.515472:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c326 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.515498:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:3.0:1788651143.515501:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651143.515506:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c200, rc 0) 00000100:00100000:3.0:1788651143.515594:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11054:x1875536389424640:12345-192.168.203.21@tcp:101:bash.0 Request processed in 310us (2772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.515603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:3.0:1788651143.517917:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.522856:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389424768 00000100:00100000:2.0:1788651143.522876:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389424768 00000100:00100000:2.0:1788651143.523040:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:2.0:1788651143.523053:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:11054:x1875536389424768:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651143.523075:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651143.523135:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c32d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651143.523208:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ca684, atime: 0x6a9ca683, ctime: 0x6a9ca684, blocks: 0xb 00010000:00010000:2.0:1788651143.523237:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1788651143.523243:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651143.523252:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.523286:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.523301:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ba00, rc 0) 00000100:00100000:2.0:1788651143.523373:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:11054:x1875536389424768:12345-192.168.203.21@tcp:101:bash.0 Request processed in 324us (5468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651143.523381:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00080000:3.0:1788651143.524989:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651143.527548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651143.527646:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389424896 00000100:00100000:0.0:1788651143.527656:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389424896 00002000:00010000:0.0:1788651143.527702:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788651143.527707:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be6cf4ed80 with x1875536389424896 ext(0->18446744073709551615) 00002000:00010000:0.0:1788651143.527794:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be6cf4ed80. 00000100:00100000:0.0:1788651143.527892:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1788651143.527905:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2353:x1875536389424896:12345-192.168.203.21@tcp:10:bash.0 00002000:00010000:0.0:1788651143.528313:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788651143.528317:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788651140 -> 1788651144 00002000:00010000:0.0:1788651143.528320:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788651139 -> 1788651139 00002000:00010000:0.0:1788651143.528338:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788651140 -> 1788651144 00002000:00010000:0.0:1788651143.528340:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788651143.528421:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2353:x1875536389424896:12345-192.168.203.21@tcp:10:bash.0 Request processed in 518us (884us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788651143.528430:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00002000:00010000:0.0:1788651143.528435:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788651143.528437:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be6cf4ed80 with x1875536389424896 ext(0->18446744073709551615) 00002000:00010000:0.0:1788651143.528443:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be6cf4ed80. 00000100:00100000:0.0:1788651143.557526:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651143.557705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651143.558347:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408290048 00000100:00100000:2.0:1788651143.558358:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408290048 00000100:00100000:2.0:1788651143.558429:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788651143.558442:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651143.558487:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651143.558611:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651143.558619:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788651143.562443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6cf4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651143.628856:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651143.628941:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389425024 00000100:00100000:3.0:1788651143.628953:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389425024 00000100:00100000:3.0:1788651143.629029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 194 00000100:00100000:3.0:1788651143.629042:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11541:x1875536389425024:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:3.0:1788651143.629154:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629177:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629194:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629221:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629250:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629257:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629551:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629567:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651143.629610:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629620:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629626:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629631:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629634:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.629638:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629644:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629678:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651143.629681:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651143.629689:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629697:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629710:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629716:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629779:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629782:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.629784:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629788:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629793:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be51759d00) 00010000:00010000:3.0:1788651143.629795:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651143.629797:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629941:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629964:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629968:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629973:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629978:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.629981:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629987:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.629996:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:3.0:1788651143.629998:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651143.630001:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.630007:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651143.630142:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11541:x1875536389425024:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 1099us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.630152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 194 00000100:00100000:2.0:1788651143.693240:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651143.693341:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389425280 00000100:00100000:0.0:1788651143.693364:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389425280 00000100:00100000:0.0:1788651143.693434:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:0.0:1788651143.693445:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+32:11545:x1875536389425280:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651143.693471:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651143.693498:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c334 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.695763:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.695794:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.695809:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.695833:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.695863:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.695871:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696235:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696244:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696252:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651143.696266:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788651143.696381:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696389:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696396:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696401:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651143.696406:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696413:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696437:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651143.696440:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651143.696446:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696454:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696468:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696474:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696480:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696485:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651143.696488:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696494:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696502:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be44b46100) 00010000:00010000:0.0:1788651143.696504:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651143.696520:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696527:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696596:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c334 expref: 35 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696611:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c334 expref: 34 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.696619:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:0.0:1788651143.696621:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788651143.696624:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861c00, rc 0) 00000100:00100000:0.0:1788651143.696706:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6cf4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:11545:x1875536389425280:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 3261us (3481us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788651143.696717:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:3.0:1788651143.702093:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651143.702395:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389425408 00000100:00100000:0.0:1788651143.702407:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389425408 00000100:00100000:0.0:1788651143.702476:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 196 00000100:00100000:0.0:1788651143.702488:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:11545:x1875536389425408:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:0.0:1788651143.702588:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.702608:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 34 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.702620:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.702781:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 34 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.702821:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 34 pid: 5871 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.702840:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408290176:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651143.703165:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788651143.714316:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651143.714432:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408290176:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651143.714465:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.715180:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389425664 00000100:00100000:0.0:1788651143.715193:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389425664 00000100:00100000:0.0:1788651143.715262:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1788651143.715274:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:5591:x1875536389425664:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788651143.730090:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:5591:x1875536389425664:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 14800us (15772us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788651143.730152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:2.0:1788651143.736682:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651143.737000:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389425792 00000100:00100000:3.0:1788651143.737014:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389425792 00010000:00010000:3.0:1788651143.737067:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 36 pid: 5871 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651143.737175:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:3.0:1788651143.737187:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:2355:x1875536389425792:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651143.737205:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651143.737213:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 36 pid: 5871 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.737230:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 36 pid: 5871 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.737259:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887977f0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c31f expref: 36 pid: 5871 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.737280:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:3.0:1788651143.737284:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.737295:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.737303:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.737335:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651143.737447:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737459:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737504:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737512:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737520:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737528:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651143.737534:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737555:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737566:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:0.0:1788651143.737570:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651143.737574:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.737582:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651143.737609:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:2355:x1875536389425792:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 423us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.737620:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:0.0:1788651143.737632:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11545:x1875536389425408:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 35146us (35553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651143.737641:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 196 00000100:00100000:3.0:1788651143.743260:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.743580:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389426048 00000100:00100000:2.0:1788651143.743592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389426048 00000100:00100000:2.0:1788651143.743737:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:2.0:1788651143.743751:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+34:11545:x1875536389426048:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651143.745214:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11545:x1875536389426048:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 1457us (1959us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788651143.745228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:2.0:1788651143.846401:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651143.846558:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389426304 00000100:00100000:0.0:1788651143.846569:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389426304 00000100:00100000:0.0:1788651143.846634:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:0.0:1788651143.846646:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+35:11556:x1875536389426304:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:0.0:1788651143.846671:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651143.846691:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c33b expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.846786:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.846801:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.846812:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.846840:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.846847:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.846853:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847159:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847169:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847176:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651143.847186:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788651143.847284:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847292:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847298:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847304:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651143.847308:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847327:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847339:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651143.847342:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651143.847347:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847353:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847365:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847370:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847374:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847379:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651143.847381:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847387:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847393:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be44b46100) 00010000:00010000:0.0:1788651143.847395:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651143.847397:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847413:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847455:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba887977f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c33b expref: 38 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847468:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c33b expref: 37 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.847476:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:0.0:1788651143.847478:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651143.847481:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861e00, rc 0) 00000100:00100000:0.0:1788651143.847544:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+37:11556:x1875536389426304:12345-192.168.203.21@tcp:101:cat.0 Request processed in 900us (1152us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788651143.847552:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:1.0:1788651143.853772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.853869:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389426560 00000100:00100000:2.0:1788651143.853881:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389426560 00000100:00100000:2.0:1788651143.853938:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:2.0:1788651143.853949:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+37:11556:x1875536389426560:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:2.0:1788651143.854217:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11556:x1875536389426560:12345-192.168.203.21@tcp:35:cat.0 Request processed in 269us (456us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788651143.854225:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 54 00000100:00100000:1.0:1788651143.892558:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651143.892697:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389426816 00000100:00100000:3.0:1788651143.892708:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389426816 00000100:00100000:3.0:1788651143.892779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 198 00000100:00100000:3.0:1788651143.892791:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11557:x1875536389426816:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:3.0:1788651143.892850:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788651143.892876:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861e00/0x84a2fba887977f82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c33b expref: 38 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.892902:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887977f58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c334 expref: 37 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.892915:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba887977f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c326 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.892925:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759700) 00010000:00010000:3.0:1788651143.892936:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651143.892956:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.892969:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.892978:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.893010:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.893017:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.893023:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.893309:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.893318:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.893326:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651143.896289:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788651143.896303:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347956195317ns, next at 348956192135ns, rc = 0 00010000:00010000:3.0:1788651143.896375:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896391:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896401:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896409:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896425:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896431:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896458:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651143.896480:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896486:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896491:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896496:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.896501:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896507:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.896707:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651143.896714:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896744:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759900) 00010000:00010000:3.0:1788651143.896747:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788651143.896753:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896760:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887977f9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896778:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896790:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896795:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896801:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651143.896804:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896811:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896820:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651143.896822:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651143.896826:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.896831:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887977f90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651143.896840:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fb87bb8 reply state 00000000ccbbff2a transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651143.896849:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651143.896943:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+37:11557:x1875536389426816:12345-192.168.203.21@tcp:36:rm.0 Request processed in 4150us (4391us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788651143.896952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 198 00010000:00010000:2.0:1788651143.900420:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651143.900433:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.900447:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.900479:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93be51759900) 00010000:00010000:2.0:1788651143.900482:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788651143.900489:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.900496:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d000/0x84a2fba887977fa5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.900535:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651143.900537:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651143.900540:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651143.900817:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.900826:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.900832:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.900837:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651143.900841:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.900848:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.900858:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be51759d00) 00010000:00010000:1.0:1788651143.900861:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651143.900864:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651143.900880:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ca00/0x84a2fba887977f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651143.978921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651143.979038:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389427072 00000100:00100000:0.0:1788651143.979050:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389427072 00000100:00100000:0.0:1788651143.979315:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 199 00000100:00100000:0.0:1788651143.979329:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+36:11563:x1875536389427072:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1788651143.979353:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651143.979373:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977fac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c342 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.979490:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.979505:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.979532:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.979547:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.979555:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.979561:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651143.980077:0:5871:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788651143.980285:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980294:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980301:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980332:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980339:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980346:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980351:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651143.980362:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980369:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980381:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651143.980384:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651143.980388:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980394:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651143.980406:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d9158cf reply state 000000004d1be663 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651143.980414:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788651143.980442:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977fac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 39 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980454:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 38 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651143.980462:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651143.980464:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651143.980466:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861800, rc 0) 00000100:00100000:0.0:1788651143.980532:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:11563:x1875536389427072:12345-192.168.203.21@tcp:101:bash.0 Request processed in 1206us (1619us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788651143.980541:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 199 00000100:00100000:0.0:1788651143.989516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:2.0:1788651143.989741:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.989756:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.989764:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.989770:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651143.989775:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.989784:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.989801:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be44b46100) 00010000:00010000:2.0:1788651143.989805:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651143.989811:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.989834:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887977fba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651143.989847:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389427200 00000100:00100000:3.0:1788651143.989860:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389427200 00000100:00100000:3.0:1788651143.989956:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:3.0:1788651143.989976:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389427200:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651143.989995:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651143.990207:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c349 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651143.990235:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:0.0:1788651143.990382:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788651143.990430:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1788651143.990436:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651143.990446:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.990467:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651143.990481:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c400, rc 0) 00000100:00100000:3.0:1788651143.990543:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2355:x1875536389427200:12345-192.168.203.21@tcp:101:bash.0 Request processed in 570us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651143.990551:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:1.0:1788651143.999512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651143.999636:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389427328 00000100:00100000:2.0:1788651143.999647:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389427328 00000100:00100000:2.0:1788651143.999708:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:2.0:1788651143.999737:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:11563:x1875536389427328:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651143.999756:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651143.999775:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c350 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.999807:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.999817:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651143.999821:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651143.999826:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.999860:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651143.999873:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 7 pid: 6675 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651143.999887:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1875536408290304:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651144.000005:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651144.004367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.004457:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389427456 00000100:00100000:0.0:1788651144.004469:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389427456 00010000:00010000:0.0:1788651144.004528:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 8 pid: 6675 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.004578:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:0.0:1788651144.004590:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389427456:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651144.004610:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651144.004640:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 8 pid: 6675 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.004658:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 8 pid: 6675 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.004691:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651144.004697:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651144.004708:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.004727:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.004773:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.004816:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875536408290432:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651144.004917:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbc9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788651144.007475:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d5a3cff/0x84a2fba887977fcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c349 expref: 8 pid: 6675 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651144.007508:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75801f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6674:1875536408290304:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651144.007550:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.007596:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ac00, rc 0) 00000100:00100000:3.0:1788651144.007688:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:11563:x1875536389427328:12345-192.168.203.21@tcp:101:bash.0 Request processed in 7970us (8184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651144.007699:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:0.0:1788651144.010769:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875536408290432:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651144.010798:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651144.010871:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2356:x1875536389427456:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 6282us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.010882:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:1.0:1788651144.019761:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.019868:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389427712 00000100:00100000:2.0:1788651144.019879:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389427712 00000100:00100000:2.0:1788651144.019938:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:2.0:1788651144.019948:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+38:11563:x1875536389427712:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1788651144.020331:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:11563:x1875536389427712:12345-192.168.203.21@tcp:35:bash.0 Request processed in 382us (578us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788651144.020339:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 55 00000100:00100000:1.0:1788651144.142389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.148816:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389427840 00000100:00100000:0.0:1788651144.148900:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389427840 00000100:00100000:0.0:1788651144.149066:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 200 00000100:00100000:0.0:1788651144.149079:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+39:11579:x1875536389427840:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651144.149137:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.149160:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c357 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.149231:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.149247:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.149260:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651144.149294:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788651144.149298:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651144.149335:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.149364:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887977fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c357 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.149385:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c357 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.149394:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651144.149397:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651144.149401:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860600, rc 0) 00000100:00100000:0.0:1788651144.149484:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:11579:x1875536389427840:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 407us (7102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.149492:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 200 00000100:00100000:1.0:1788651144.155318:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.156965:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389428096 00000100:00100000:0.0:1788651144.156980:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389428096 00000100:00100000:0.0:1788651144.157128:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00100000:0.0:1788651144.157142:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+40:11579:x1875536389428096:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651144.157167:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.157191:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c35e expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.157318:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.157336:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.157364:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651144.157377:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788651144.157507:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba887977feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c35e expref: 43 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.157527:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c35e expref: 42 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.157537:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.157540:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651144.157544:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861000, rc 0) 00000100:00100000:0.0:1788651144.157624:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:11579:x1875536389428096:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 484us (2314us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788651144.157631:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00100000:1.0:1788651144.163135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.163188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389428224 00000100:00100000:2.0:1788651144.163200:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389428224 00000100:00100000:2.0:1788651144.163266:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:2.0:1788651144.163277:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+42:2355:x1875536389428224:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651144.163292:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651144.163445:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba887977ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c35e expref: 42 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.163467:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.163472:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651144.163592:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:2355:x1875536389428224:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 307us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651144.163600:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:1.0:1788651144.170488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651144.170783:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389428480 00000100:00100000:3.0:1788651144.170795:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389428480 00000100:00100000:3.0:1788651144.171063:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:3.0:1788651144.171072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+41:11579:x1875536389428480:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651144.171093:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651144.171141:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887978000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c365 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.171237:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887978007 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.171252:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887978007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.171270:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887978007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651144.171283:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788651144.172907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887978000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c365 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.172932:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887978007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c365 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.172955:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.172958:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788651144.172962:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56cc00, rc 0) 00000100:00100000:2.0:1788651144.173032:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:11579:x1875536389428480:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1961us (2553us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788651144.173042:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 202 00000100:00100000:1.0:1788651144.185221:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.185315:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389428608 00000100:00100000:0.0:1788651144.185327:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389428608 00000100:00100000:0.0:1788651144.185389:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1788651144.185400:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+6:2353:x1875536389428608:12345-192.168.203.21@tcp:1:lfs.0 00010000:00010000:0.0:1788651144.185442:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.185462:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.185470:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651144.185486:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651144.185491:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.185526:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.185540:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 6 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.185555:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408290560:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651144.185647:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651144.188017:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1875536408290560:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651144.188047:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651144.188643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.188735:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389428736 00000100:00100000:2.0:1788651144.188742:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389428736 00002000:00100000:2.0:1788651144.188791:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93be750e8a80 x1875536389428736/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:285/0 lens 504/0 e 0 to 0 dl 1788651155 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651144.188801:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be750e8a80 with x1875536389428736 ext(0->8) 00010000:00010000:2.0:1788651144.188809:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 7 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.188823:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 7 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651144.188829:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be750e8a80 00000100:00100000:2.0:1788651144.188855:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:2.0:1788651144.188865:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389428736:12345-192.168.203.21@tcp:4:lfs.0 00000100:00100000:2.0:1788651144.189547:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2355:x1875536389428736:12345-192.168.203.21@tcp:4:lfs.0 Request processed in 681us (913us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788651144.189557:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00100000:2.0:1788651144.189565:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93be750e8a80 x1875536389428736/t4294967308(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:285/0 lens 504/448 e 0 to 0 dl 1788651155 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651144.189580:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be750e8a80 with x1875536389428736 ext(0->8) 00010000:00010000:2.0:1788651144.189586:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 9 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.189598:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 9 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651144.189606:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93be750e8a80 00000100:00100000:1.0:1788651144.191945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.192052:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389428864 00000100:00100000:2.0:1788651144.192062:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389428864 00010000:00010000:2.0:1788651144.192095:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 9 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651144.192157:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:2.0:1788651144.192172:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389428864:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651144.192186:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788651144.192202:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788651144.192204:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788651144 00002000:00010000:2.0:1788651144.192206:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788651144 00002000:00010000:2.0:1788651144.192208:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788651144 00010000:00010000:2.0:1788651144.192212:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 9 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.192222:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 9 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.192252:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887977fd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c350 expref: 9 pid: 6674 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.192264:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651144.192268:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651144.192272:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.192278:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.192305:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651144.192348:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389428864:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 183us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651144.192353:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00010000:00010000:1.0:1788651144.192449:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192456:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192475:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192481:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192486:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192496:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651144.192499:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192504:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192512:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651144.192517:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba887978015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651144.192549:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2353:x1875536389428608:12345-192.168.203.21@tcp:1:lfs.0 Request processed in 7153us (7346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651144.192554:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1788651144.196797:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651144.197351:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389429120 00000100:00100000:3.0:1788651144.197363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389429120 00000100:00100000:3.0:1788651144.197428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 56 00000100:00100000:3.0:1788651144.197441:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57baf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+43:11579:x1875536389429120:12345-192.168.203.21@tcp:35:lfs.0 00000004:00010000:3.0:1788651144.197516:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887978007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c365 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651144.199538:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788651144.199623:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788651144.200359:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788651144.200428:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.200448:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 47 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.200458:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.200499:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 47 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.200534:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 47 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651144.200551:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75800380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875536408290688:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651144.200648:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651144.203320:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75800380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875536408290688:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651144.203352:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651144.205373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.205464:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389429248 00000100:00100000:2.0:1788651144.205475:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389429248 00010000:00010000:2.0:1788651144.205520:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 48 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651144.205561:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:2.0:1788651144.205572:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+48:2355:x1875536389429248:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651144.205588:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651144.205596:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 48 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.205610:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 48 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.205631:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887977fc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c342 expref: 48 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.205648:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.205654:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.205680:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.205687:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.205729:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651144.205798:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+47:2355:x1875536389429248:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 223us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651144.205806:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00010000:00010000:0.0:1788651144.205834:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.205844:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651144.206393:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788651144.206610:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788651144.206734:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408290816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788651144.206778:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651144.206806:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788651144.206828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408290816 00000100:00100000:2.0:1788651144.206835:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408290816 00000100:00100000:2.0:1788651144.206879:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788651144.206953:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875536408290816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788651144.207036:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875536408290816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651144.207044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788651144.207175:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408290816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788651144.207559:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788651144.207772:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408290944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788651144.207805:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651144.207831:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651144.207926:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408290944 00000100:00100000:1.0:1788651144.207931:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408290944 00000100:00100000:1.0:1788651144.207961:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651144.207968:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875536408290944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788651144.208649:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875536408290944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 679us (841us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788651144.208656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651144.208741:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875536408290944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788651144.208794:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788651144.208833:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.208843:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.208852:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.208858:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651144.208863:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.208872:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.208888:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.208891:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788651144.208901:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.208907:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba88797801c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651144.209161:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788651144.209624:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788651144.209637:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348269529229ns, next at 349269526780ns, rc = 0 00000001:00080000:0.0:1788651144.209644:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788651144.209682:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.209686:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788651144.209693:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56cc00/0x84a2fba887978007 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c365 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.209802:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57baf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:11579:x1875536389429120:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 12364us (13015us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788651144.209811:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 56 00000020:00080000:0.0:1788651144.209815:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788651144.218515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.218573:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389429376 00000100:00100000:0.0:1788651144.218593:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389429376 00000100:00100000:0.0:1788651144.218658:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:0.0:1788651144.218671:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+50:11579:x1875536389429376:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651144.218696:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.218727:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887978023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c36c expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.218798:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887978023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c36c expref: 51 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.218832:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887978023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c36c expref: 51 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.218865:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.218868:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651144.218872:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860400, rc 0) 00000100:00100000:0.0:1788651144.219287:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:11579:x1875536389429376:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 617us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.219295:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:2.0:1788651144.225676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651144.225784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389429632 00000100:00100000:1.0:1788651144.225796:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389429632 00000100:00100000:1.0:1788651144.225895:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:1.0:1788651144.225906:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+51:11579:x1875536389429632:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651144.226179:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11579:x1875536389429632:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 275us (517us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788651144.226187:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:1.0:1788651144.294486:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.294552:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389429760 00000100:00100000:0.0:1788651144.294564:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389429760 00000100:00100000:0.0:1788651144.294662:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:0.0:1788651144.294673:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11589:x1875536389429760:12345-192.168.203.21@tcp:34:lfs.0 00010000:00010000:0.0:1788651144.294765:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294781:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294792:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294806:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294813:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294836:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294926:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294933:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294940:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651144.294978:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294990:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.294996:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295003:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295009:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651144.295013:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295020:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295030:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651144.295039:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651144.295044:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295051:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797802a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295065:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295071:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295076:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295082:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651144.295085:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295090:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295223:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be44b46d00) 00010000:00010000:0.0:1788651144.295292:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651144.295297:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295303:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295316:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295328:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295349:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295354:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651144.295358:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295363:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295371:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.295373:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651144.295375:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.295380:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.295457:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be765e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11589:x1875536389429760:12345-192.168.203.21@tcp:34:lfs.0 Request processed in 785us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.295466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 204 00000100:00100000:2.0:1788651144.364492:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651144.365024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389430016 00000100:00100000:3.0:1788651144.365035:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389430016 00000100:00100000:3.0:1788651144.365104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:3.0:1788651144.365145:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+52:11592:x1875536389430016:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651144.365167:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651144.365189:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba88797803f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c373 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366046:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366065:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366078:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366094:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366133:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366258:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887978054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366278:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887978054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366285:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887978054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651144.366296:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788651144.366387:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366395:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366402:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366420:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651144.366425:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366432:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366444:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651144.366448:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651144.366452:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366459:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366472:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366485:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366491:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366496:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651144.366499:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366515:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366523:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be51759600) 00010000:00010000:3.0:1788651144.366526:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651144.366529:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366535:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797804d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366595:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba88797803f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c373 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366609:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887978054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c373 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.366617:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651144.366619:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651144.366629:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d800, rc 0) 00000100:00100000:3.0:1788651144.366899:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:11592:x1875536389430016:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1755us (2414us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788651144.366907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:3.0:1788651144.376597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.376682:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389430144 00000100:00100000:2.0:1788651144.376695:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389430144 00000100:00100000:2.0:1788651144.376765:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:2.0:1788651144.376778:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:11592:x1875536389430144:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:2.0:1788651144.376846:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376863:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376887:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376914:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376921:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376928:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376946:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651144.376951:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376959:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376970:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.376973:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651144.376977:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.376983:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651144.377061:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:11592:x1875536389430144:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 286us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651144.377069:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 206 00000100:00100000:3.0:1788651144.379863:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.380048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389430400 00000100:00100000:2.0:1788651144.380072:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389430400 00000100:00100000:2.0:1788651144.380148:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:2.0:1788651144.380160:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+54:11592:x1875536389430400:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1788651144.380392:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:11592:x1875536389430400:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 234us (535us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788651144.380400:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 58 00000100:00100000:1.0:1788651144.511881:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.512375:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389430656 00000100:00100000:0.0:1788651144.512387:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389430656 00000100:00100000:0.0:1788651144.512483:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:0.0:1788651144.512495:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+55:11602:x1875536389430656:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1788651144.512528:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.512539:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788651144.512565:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba887977fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c357 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.512582:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651144.512587:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651144.512600:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978069 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c37a expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.512706:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.512729:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.512740:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651144.512759:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788651144.512882:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978069 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c37a expref: 57 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.512894:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c37a expref: 56 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.512901:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.512903:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651144.512906:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861400, rc 0) 00000100:00100000:0.0:1788651144.512984:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11602:x1875536389430656:12345-192.168.203.21@tcp:101:bash.0 Request processed in 491us (1111us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788651144.513000:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 207 00010000:00010000:2.0:1788651144.517153:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651144.519345:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.519487:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389430912 00000100:00100000:2.0:1788651144.519498:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389430912 00000100:00100000:2.0:1788651144.519566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 208 00000100:00100000:2.0:1788651144.519578:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11602:x1875536389430912:12345-192.168.203.21@tcp:36:bash.0 00010000:00010000:2.0:1788651144.519637:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788651144.519663:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861400/0x84a2fba887978070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c37a expref: 56 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.519686:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d800/0x84a2fba887978054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c373 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.519697:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.519701:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651144.519906:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.519919:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.519929:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651144.520014:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788651144.520051:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dfcf358 reply state 0000000060fbe5f5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651144.520060:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651144.520174:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11602:x1875536389430912:12345-192.168.203.21@tcp:36:bash.0 Request processed in 598us (837us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788651144.520183:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 208 00000020:00080000:2.0:1788651144.520188:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788651144.523746:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.523764:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.523771:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.523778:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651144.523782:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.523790:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.523806:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.523809:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651144.523814:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.523820:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797807e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651144.529549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.530539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389431040 00000100:00100000:0.0:1788651144.530552:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389431040 00000100:00100000:0.0:1788651144.530619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:0.0:1788651144.530630:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+56:11602:x1875536389431040:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:0.0:1788651144.530656:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.530689:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c381 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.530779:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.530793:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.530804:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651144.530833:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788651144.530837:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651144.530856:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.530883:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.530899:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.530907:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.530910:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651144.530913:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860600, rc 0) 00000100:00100000:0.0:1788651144.531301:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11602:x1875536389431040:12345-192.168.203.21@tcp:101:bash.0 Request processed in 671us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.531310:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:1.0:1788651144.535933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.536442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389431296 00000100:00100000:2.0:1788651144.536454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389431296 00000100:00100000:2.0:1788651144.536519:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1788651144.536530:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+57:11602:x1875536389431296:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:2.0:1788651144.536771:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11602:x1875536389431296:12345-192.168.203.21@tcp:35:bash.0 Request processed in 243us (846us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788651144.536780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 59 00000100:00100000:2.0:1788651144.597416:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.598086:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389431424 00000100:00100000:0.0:1788651144.598137:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389431424 00000100:00100000:0.0:1788651144.598319:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:0.0:1788651144.598332:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+58:11608:x1875536389431424:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651144.598373:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.598397:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978093 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c388 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.598460:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797809a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.598474:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.598485:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651144.598519:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788651144.598523:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651144.598540:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797809a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.598564:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba887978093 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c388 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.598803:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797809a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c388 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.598814:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651144.598816:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651144.598820:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860a00, rc 0) 00000100:00100000:0.0:1788651144.598888:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11608:x1875536389431424:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 560us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.598895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 210 00000100:00100000:3.0:1788651144.602065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651144.605683:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389431552 00000100:00100000:2.0:1788651144.605700:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389431552 00000100:00100000:2.0:1788651144.607567:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:2.0:1788651144.607585:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11608:x1875536389431552:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651144.607608:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651144.607629:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879780a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c38f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.607695:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.607735:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.607758:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.607775:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.607950:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.607960:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608055:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608063:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608070:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651144.608131:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788651144.608135:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651144.608154:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608166:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608185:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608191:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608196:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608201:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651144.608205:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608212:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608223:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:2.0:1788651144.608225:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651144.608229:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608235:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ae00/0x84a2fba8879780a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608258:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608264:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608269:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608290:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651144.608293:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608299:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608308:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be449ae400) 00010000:00010000:2.0:1788651144.608311:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651144.608313:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608318:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879780af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608359:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618aa00/0x84a2fba8879780a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 61 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608373:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.608379:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.608381:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651144.608384:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b800, rc 0) 00000100:00100000:2.0:1788651144.608459:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11608:x1875536389431552:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 878us (6400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651144.608467:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:1.0:1788651144.615649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651144.615990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.616567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389431808 00000100:00100000:0.0:1788651144.616579:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389431808 00000100:00100000:0.0:1788651144.616644:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:0.0:1788651144.616656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11608:x1875536389431808:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1788651144.616677:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651144.616698:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c396 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.616869:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.616886:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.616895:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 61 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.616903:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.616938:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 61 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.616951:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 61 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.616985:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408291072:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651144.617908:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389431936 00000100:00100000:2.0:1788651144.617927:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389431936 00010000:00010000:2.0:1788651144.617960:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 62 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651144.617992:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:2.0:1788651144.618000:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:2355:x1875536389431936:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651144.618011:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651144.618016:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 62 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.618029:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 62 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.618047:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651144.618052:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.618059:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651144.618065:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651144.619514:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.619532:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 62 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.619547:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408291200:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651144.619603:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be538a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651144.619857:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:2355:x1875536389431936:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1853us (3864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651144.619868:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00010000:00010000:0.0:1788651144.623148:0:5841:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.21@tcp) returned -22 from blocking AST (req@000000004cbf5179 x1875536408291072) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 61 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.623173:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba8879780b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c38f expref: 61 pid: 5871 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651144.623191:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408291072:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651144.627047:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651144.627961:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432064 00000100:00100000:3.0:1788651144.627974:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432064 00010000:00010000:3.0:1788651144.628021:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 61 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651144.628075:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:3.0:1788651144.628094:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:2356:x1875536389432064:12345-192.168.203.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788651144.628604:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408291200:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651144.628635:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.628641:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.628650:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.628678:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629678:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651144.629693:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 61 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629707:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 61 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629738:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860600/0x84a2fba88797808c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c381 expref: 61 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629762:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651144.629766:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629773:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629781:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.629812:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651144.629871:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:2356:x1875536389432064:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1786us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651144.629879:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00010000:00010000:0.0:1788651144.631433:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.631448:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651144.631472:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788651144.631642:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.631661:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.631668:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:0.0:1788651144.631671:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651144.631676:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861200, rc 0) 00000100:00100000:0.0:1788651144.631745:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11608:x1875536389431808:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 15091us (16104us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788651144.631753:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 212 00000100:00100000:2.0:1788651144.639863:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651144.639937:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432320 00000100:00100000:3.0:1788651144.639949:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432320 00000100:00100000:3.0:1788651144.640027:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:3.0:1788651144.640040:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11608:x1875536389432320:12345-192.168.203.21@tcp:103:lfs.0 00010000:00010000:3.0:1788651144.640061:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651144.640087:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860400/0x84a2fba887978023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c36c expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.640104:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651144.640152:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651144.640209:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11608:x1875536389432320:12345-192.168.203.21@tcp:103:lfs.0 Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651144.640216:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:1.0:1788651144.647594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651144.647734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432448 00000100:00100000:0.0:1788651144.647745:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432448 00000100:00100000:0.0:1788651144.647812:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:0.0:1788651144.647824:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11608:x1875536389432448:12345-192.168.203.21@tcp:58:lfs.0 00010000:00010000:0.0:1788651144.647920:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.647952:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651144.647965:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651144.648204:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788651144.648288:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11608:x1875536389432448:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 465us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651144.648296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:1.0:1788651144.652702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651144.653150:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432576 00000100:00100000:3.0:1788651144.653163:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432576 00000100:00100000:3.0:1788651144.653216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 214 00000100:00100000:3.0:1788651144.653226:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+59:11608:x1875536389432576:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651144.653259:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651144.653281:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c39d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.653343:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.653354:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.653372:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.653385:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.653398:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651144.653401:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651144.653404:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651144.653412:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c200, rc 0) 00000100:00100000:3.0:1788651144.653475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11608:x1875536389432576:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 250us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651144.653482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 214 00000100:00100000:0.0:1788651145.092260:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408291328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651145.092360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651145.092620:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408291328 00000100:00100000:1.0:1788651145.092630:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408291328 00000100:00100000:1.0:1788651145.092703:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788651145.092732:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875536408291328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651145.092768:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651145.092825:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875536408291328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651145.092832:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788651145.092834:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651145.093101:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408291328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651145.181182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.181226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.181260:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.181297:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.181345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389433088 00000100:00100000:1.0:1788651145.181356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389433088 00000100:00100000:1.0:1788651145.181417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 143 00000100:00100000:1.0:1788651145.181429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389433088:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651145.181506:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2356:x1875536389433088:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651145.181514:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 143 00000100:00080000:1.0:1788651145.181537:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651145.181686:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432704 00000100:00100000:0.0:1788651145.181691:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432704 00000100:00100000:0.0:1788651145.181731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 289 00000100:00100000:0.0:1788651145.181738:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389432704:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651145.181780:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389432704:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 42us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.181782:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432960 00000100:00100000:3.0:1788651145.181788:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432960 00000100:00100000:0.0:1788651145.181792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 289 00000100:00100000:3.0:1788651145.181835:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389432832 00000100:00100000:3.0:1788651145.181839:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389432832 00000100:00080000:0.0:1788651145.181841:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651145.181848:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651145.181871:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:0.0:1788651145.181894:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:0.0:1788651145.181903:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389432832:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651145.181930:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389432832:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 28us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651145.181946:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:3.0:1788651145.182069:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389432960:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651145.182101:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389432960:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 222us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.182140:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00000040:00080000:1.0:1788651145.284374:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651145.284384:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651145.284420:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788651145.284427:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651145.284550:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe70e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408291456:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651145.284685:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651145.298612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.298761:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe70e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408291456:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788651145.299173:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389433216 00000100:00100000:3.0:1788651145.299181:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389433216 00000100:00100000:3.0:1788651145.299255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:3.0:1788651145.299266:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11609:x1875536389433216:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651145.299297:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651145.299418:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11609:x1875536389433216:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 154us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.299426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00080000:0.0:1788651145.303321:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651145.304217:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.304589:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389433344 00000100:00100000:1.0:1788651145.304601:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389433344 00000100:00100000:1.0:1788651145.304665:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 216 00000100:00100000:1.0:1788651145.304676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11609:x1875536389433344:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788651145.304766:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304797:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304859:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304883:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304889:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304923:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304931:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.304936:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651145.304973:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788651145.304986:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651145.305001:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305012:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305019:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305034:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305040:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651145.305044:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305058:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305070:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:1.0:1788651145.305073:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651145.305078:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305084:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba8879780e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305099:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305172:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305180:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305186:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651145.305189:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305195:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305203:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93be58f79600) 00010000:00010000:1.0:1788651145.305206:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651145.305209:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305228:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879780e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305244:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305250:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305256:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305261:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651145.305264:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305270:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305277:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:1.0:1788651145.305279:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651145.305282:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.305289:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c800/0x84a2fba8879780ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.305382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11609:x1875536389433344:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 707us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651145.305390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 216 00000100:00100000:1.0:1788651145.312201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.312328:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389433600 00000100:00100000:3.0:1788651145.312340:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389433600 00000100:00100000:3.0:1788651145.312441:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00100000:3.0:1788651145.312452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+60:11609:x1875536389433600:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.312473:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651145.312492:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879780f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312613:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312629:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312642:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651145.312653:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788651145.312770:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312779:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312787:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312793:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.312798:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312806:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312818:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651145.312821:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788651145.312825:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312842:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba8879780fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312885:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879780f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3a4 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312906:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:3.0:1788651145.312909:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651145.312914:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879780f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3a4 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.312923:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d600, rc 0) 00000100:00100000:3.0:1788651145.312997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11609:x1875536389433600:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 546us (803us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788651145.313005:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00100000:1.0:1788651145.326836:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.327409:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389433728 00000100:00100000:0.0:1788651145.327421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389433728 00000100:00100000:0.0:1788651145.327530:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:0.0:1788651145.327541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11609:x1875536389433728:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788651145.327580:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788651145.327727:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11609:x1875536389433728:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 187us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651145.327734:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:1.0:1788651145.334914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.335454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389433984 00000100:00100000:0.0:1788651145.335465:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389433984 00000100:00100000:0.0:1788651145.335604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:0.0:1788651145.335615:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11609:x1875536389433984:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651145.335637:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651145.335640:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788651145.335669:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba88797809a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c388 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.335689:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:0.0:1788651145.335694:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651145.336957:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797810a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3ab expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651145.337728:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788651145.338855:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887978111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.338871:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887978111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.338882:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887978111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.339285:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797810a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ab expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.339305:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887978111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ab expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.339314:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:0.0:1788651145.339317:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651145.339320:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861600, rc 0) 00000100:00100000:0.0:1788651145.339433:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11609:x1875536389433984:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 3820us (4534us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788651145.339442:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:1.0:1788651145.344933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.345372:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389434240 00000100:00100000:3.0:1788651145.345384:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389434240 00000100:00100000:3.0:1788651145.345476:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:3.0:1788651145.345488:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11609:x1875536389434240:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.345553:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651145.345580:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861600/0x84a2fba887978111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ab expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.345598:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be44b46d00) 00010000:00010000:3.0:1788651145.345608:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651145.345628:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.345651:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.345661:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348226:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348250:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348261:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348328:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348335:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348340:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348346:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.348350:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348357:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348368:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651145.348384:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651145.348389:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348395:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797811f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348887:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348899:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348905:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348910:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.348912:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348919:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348927:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1a47089b (ffff93be51759600) 00010000:00010000:3.0:1788651145.348930:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651145.348933:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.348939:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba887978126 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1a47089b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.349131:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11609:x1875536389434240:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 3616us (4178us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651145.349147:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:1.0:1788651145.353261:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.353335:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389434368 00000100:00100000:3.0:1788651145.353345:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389434368 00000100:00100000:3.0:1788651145.353405:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 221 00000100:00100000:3.0:1788651145.353416:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+61:11609:x1875536389434368:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.353563:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651145.353587:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797812d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3b2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.353631:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.353645:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.353655:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.353828:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797812d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.353847:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.353855:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:3.0:1788651145.353858:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651145.353861:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d200, rc 0) 00000100:00100000:3.0:1788651145.353920:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11609:x1875536389434368:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 506us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.353934:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 221 00000100:00100000:1.0:1788651145.358845:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.359144:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389434624 00000100:00100000:0.0:1788651145.359156:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389434624 00000100:00100000:0.0:1788651145.359222:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 222 00000100:00100000:0.0:1788651145.359233:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+62:11609:x1875536389434624:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651145.359319:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.359349:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.359361:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651145.359609:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788651145.359618:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349419510298ns, next at 350419507763ns, rc = 0 00000004:00010000:0.0:1788651145.359698:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c5bb1f4 reply state 0000000054f4bdd1 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.359715:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651145.359810:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11609:x1875536389434624:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 578us (974us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788651145.359817:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 222 00010000:00010000:3.0:1788651145.363098:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.363140:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.363148:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.363154:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.363158:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.363165:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.363180:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:3.0:1788651145.363183:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788651145.363188:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.363203:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861000/0x84a2fba88797813b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.366875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651145.367063:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389434752 00000100:00100000:2.0:1788651145.367074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389434752 00000100:00100000:2.0:1788651145.367166:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 223 00000100:00100000:2.0:1788651145.367178:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+63:11609:x1875536389434752:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651145.367202:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651145.367235:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3b9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.367295:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.367310:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.367329:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:2.0:1788651145.367332:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651145.367337:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:2.0:1788651145.367562:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11609:x1875536389434752:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 384us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651145.367569:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 223 00000100:00100000:2.0:1788651145.376736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.377044:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389434880 00000100:00100000:0.0:1788651145.377056:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389434880 00000100:00100000:3.0:1788651145.377596:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:3.0:1788651145.377611:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389434880:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788651145.377957:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:2356:x1875536389434880:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 349us (1231us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788651145.377966:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:2.0:1788651145.381757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.381845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389435136 00000100:00100000:1.0:1788651145.381856:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389435136 00000100:00100000:1.0:1788651145.381922:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:1.0:1788651145.381934:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+64:11609:x1875536389435136:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788651145.382184:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+65:11609:x1875536389435136:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 252us (437us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788651145.382192:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 60 00000100:00100000:1.0:1788651145.386421:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.386545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389435392 00000100:00100000:0.0:1788651145.386556:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389435392 00000100:00100000:0.0:1788651145.386627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:0.0:1788651145.386638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+65:11609:x1875536389435392:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788651145.386769:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+65:11609:x1875536389435392:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 133us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651145.386776:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 224 00000100:00100000:2.0:1788651145.390476:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.390541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389435520 00000100:00100000:0.0:1788651145.390552:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389435520 00000100:00100000:0.0:1788651145.390628:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 225 00000100:00100000:0.0:1788651145.390639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+65:11609:x1875536389435520:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651145.390674:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651145.390696:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887978149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3c0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.390801:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887978150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.390822:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887978150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.390834:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887978150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651145.390867:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651145.390884:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887978150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.390904:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba887978149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c0 expref: 67 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.390916:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887978150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c0 expref: 66 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.390922:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:0.0:1788651145.390923:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788651145.390926:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861c00, rc 0) 00000100:00100000:0.0:1788651145.391002:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+66:11609:x1875536389435520:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 364us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651145.391008:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 225 00000100:00100000:2.0:1788651145.396948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.397029:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389435648 00000100:00100000:3.0:1788651145.397040:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389435648 00000100:00100000:3.0:1788651145.397182:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:3.0:1788651145.397206:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+10:2355:x1875536389435648:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.397226:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651145.397247:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3c7 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651145.397274:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca689, blocks: 0x1 00010000:00010000:3.0:1788651145.397292:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788651145.397297:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651145.397307:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 11 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.397337:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 11 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.397352:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c800, rc 0) 00000100:00100000:3.0:1788651145.397434:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:2355:x1875536389435648:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 230us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.397441:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:1.0:1788651145.408075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.408189:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389435904 00000100:00100000:3.0:1788651145.408201:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389435904 00000100:00100000:3.0:1788651145.408256:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 226 00000100:00100000:3.0:1788651145.408266:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+66:11609:x1875536389435904:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651145.408375:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+66:11609:x1875536389435904:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.408383:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 226 00000100:00100000:1.0:1788651145.413281:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.414886:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436032 00000100:00100000:0.0:1788651145.414900:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436032 00000100:00100000:0.0:1788651145.414969:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:0.0:1788651145.414981:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:11609:x1875536389436032:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651145.414999:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651145.415018:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3ce expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.415050:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.415060:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651145.415064:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651145.415070:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.415103:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.415395:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.415411:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408291584:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651145.415509:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45a1a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651145.418518:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.418650:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408291584:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651145.418684:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 12 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.418733:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861e00, rc 0) 00000100:00100000:3.0:1788651145.418795:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:11609:x1875536389436032:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 3817us (5523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.418803:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:2.0:1788651145.420246:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436160 00000100:00100000:2.0:1788651145.420258:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436160 00010000:00010000:2.0:1788651145.420304:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651145.420395:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:2.0:1788651145.420422:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:2355:x1875536389436160:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651145.420437:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651145.420462:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.420476:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.420509:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba887978157 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c7 expref: 12 pid: 6672 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.420524:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651145.420527:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651145.420535:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.420543:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.420595:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 11 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651145.420611:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875536408291712:192.168.203.21@tcp:105: 00000100:00100000:2.0:1788651145.420765:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651145.428542:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875536408291712:192.168.203.21@tcp:105: 00010000:00010000:2.0:1788651145.428583:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651145.428671:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:2355:x1875536389436160:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 8252us (10160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651145.428682:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:1.0:1788651145.429496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.429625:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436288 00000100:00100000:0.0:1788651145.429642:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436288 00002000:00100000:0.0:1788651145.429717:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93be75406300 x1875536389436288/t0(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:286/0 lens 504/0 e 0 to 0 dl 1788651156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788651145.429729:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be75406300 with x1875536389436288 ext(0->12) 00002000:00010000:0.0:1788651145.429734:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be75406300 00000100:00100000:0.0:1788651145.429766:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1788651145.429776:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+11:2355:x1875536389436288:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788651145.430271:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2355:x1875536389436288:12345-192.168.203.21@tcp:4:lhsmtool_posix.0 Request processed in 494us (776us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788651145.430279:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00002000:00100000:0.0:1788651145.430287:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93be75406300 x1875536389436288/t4294967320(0) o4->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:286/0 lens 504/448 e 0 to 0 dl 1788651156 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788651145.430295:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be75406300 with x1875536389436288 ext(0->12) 00002000:00010000:0.0:1788651145.430299:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be75406300 00000100:00100000:2.0:1788651145.437631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.438133:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436416 00000100:00100000:3.0:1788651145.438144:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436416 00000100:00100000:3.0:1788651145.438207:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 227 00000100:00100000:3.0:1788651145.438218:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+66:11609:x1875536389436416:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788651145.518955:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788651145.518968:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788651145.518990:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788651145.519012:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be74fbc900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788651145.519017:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be6d57e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93be74fbc9c0 00000020:00080000:1.0:1788651145.519020:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be6d57ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be7562b400 00000020:00080000:1.0:1788651145.519049:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be65b99300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788651145.519053:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be42e99800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93be65b99e40 00000020:00080000:1.0:1788651145.519069:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be42e99200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be75610c00 00000020:00080000:1.0:1788651145.519077:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788651145.519182:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1788651145.519208:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408291840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788651145.519272:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651145.519329:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408291968:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788651145.519339:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788651145.519350:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408292096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788651145.519351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651145.519374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651145.519409:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408291840 00000100:00100000:1.0:1788651145.519416:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408291840 00000100:00100000:2.0:1788651145.519499:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408291968 00000100:00100000:2.0:1788651145.519503:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408291968 00000100:00100000:2.0:1788651145.519554:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408292096 00000100:00100000:2.0:1788651145.519557:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408292096 00000100:00100000:2.0:1788651145.519585:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788651145.519593:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408291968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788651145.519618:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788651145.519648:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ca688, atime: 0x6a9ca688, ctime: 0x6a9ca688, blocks: 0x1 00010000:00010000:2.0:1788651145.519656:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.519671:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788651145.519676:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651145.519681:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.519697:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.519715:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.519735:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.519758:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651145.519809:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651145.519817:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.519824:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618aa00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651145.519829:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.519838:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.519865:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.519873:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7e923e/0x84a2fba887978165 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.519889:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651145.519891:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651145.519892:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651145.520003:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651145.520010:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875536408292096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788651145.520218:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875536408291968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 625us (864us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788651145.520225:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00002000:00010000:1.0:1788651145.520228:0:10263:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788651145.520230:0:10263:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788651146 00002000:00010000:1.0:1788651145.520237:0:10263:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788651145.520239:0:10263:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788651145 -> 1788651146 00000100:00100000:2.0:1788651145.520241:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00002000:00010000:1.0:1788651145.520242:0:10263:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788651145.520247:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1875536408291840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788651145.520258:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788651145.520269:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.520284:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.520292:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788651145.520296:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651145.520300:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.520309:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875536408292096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 300us (934us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788651145.520315:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1788651145.520323:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651145.520332:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00010000:00010000:2.0:1788651145.520337:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 12 pid: 6674 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651145.520355:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1875536408292224:192.168.203.21@tcp:104: 00000004:00080000:1.0:1788651145.520384:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00080000:1.0:1788651145.523098:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788651145.523291:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be7540f800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788651145.523305:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408291968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788651145.523323:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e56c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788651145.523352:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be75407800/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788651145.523359:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408292096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788651145.523407:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11609:x1875536389436416:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 85189us (85783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.523417:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 227 00000100:00100000:1.0:1788651145.526260:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.526359:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436544 00000100:00100000:3.0:1788651145.526368:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436544 00000100:00100000:2.0:1788651145.526386:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1875536408292224:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651145.526410:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 13 pid: 6674 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.526413:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.526480:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:3.0:1788651145.526490:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+13:2356:x1875536389436544:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651145.526504:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651145.526511:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 13 pid: 6674 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.526523:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 13 pid: 6674 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.526545:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000389c4d15/0x84a2fba887977f27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c32d expref: 13 pid: 6674 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.526560:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651145.526564:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651145.526570:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.526801:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.526883:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651145.526940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:2356:x1875536389436544:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 450us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.526948:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00010000:00010000:2.0:1788651145.531323:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531353:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531367:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531376:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.531666:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651145.531700:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651145.531718:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531726:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651145.531731:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531754:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531773:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531780:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000394244df/0x84a2fba88797816c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.531805:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651145.531808:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651145.531810:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651145.533323:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1875536408291840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13068us (14042us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788651145.533336:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788651145.533515:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be75405880/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788651145.533523:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408291840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788651145.536164:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651145.536209:0:10263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436672 00000100:00100000:2.0:1788651145.536222:0:10263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436672 00000100:00100000:2.0:1788651145.536277:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:2.0:1788651145.536288:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+12:2355:x1875536389436672:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.541524:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788651145.588385:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1788651145.588405:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1788651145.588411:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788651145.588422:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1788651145.588575:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389436672:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 52283us (52413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651145.588587:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:0.0:1788651145.593073:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.593724:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389436928 00000100:00100000:1.0:1788651145.593750:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389436928 00000100:00100000:1.0:1788651145.593820:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 228 00000100:00100000:1.0:1788651145.593831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11609:x1875536389436928:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788651145.593894:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651145.593925:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861c00/0x84a2fba887978150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3c0 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.593945:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:1.0:1788651145.593953:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651145.593987:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.594003:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.594260:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651145.594509:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0709796 reply state 0000000031c5b38c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.594520:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651145.594627:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:11609:x1875536389436928:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 797us (1563us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788651145.594636:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 228 00010000:00010000:0.0:1788651145.595992:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.596003:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.596008:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.596011:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651145.596015:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.596023:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.596053:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:0.0:1788651145.596056:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651145.596061:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.596068:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9de00/0x84a2fba887978173 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.602002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.602265:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389437056 00000100:00100000:3.0:1788651145.602276:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389437056 00000100:00100000:3.0:1788651145.602419:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:3.0:1788651145.602430:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2354:x1875536389437056:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788651145.602730:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788651145.602734:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788651146 -> 1788651145 00002000:00010000:3.0:1788651145.602736:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788651144 00002000:00010000:3.0:1788651145.602738:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788651146 -> 1788651145 00002000:00010000:3.0:1788651145.602740:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788651145.602851:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2354:x1875536389437056:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 422us (857us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788651145.602859:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:2.0:1788651145.611838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.611937:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389437312 00000100:00100000:0.0:1788651145.611947:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389437312 00000100:00100000:3.0:1788651145.612149:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 229 00000100:00100000:3.0:1788651145.612162:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:11609:x1875536389437312:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.612221:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.612234:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.612254:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.612281:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.612291:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 20 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.612302:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408292352:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651145.612373:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be48b06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651145.614461:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875536408292352:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651145.614489:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651145.614932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.615254:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389437440 00000100:00100000:3.0:1788651145.615263:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389437440 00010000:00010000:3.0:1788651145.615303:0:11151:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 21 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.615374:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:3.0:1788651145.615384:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:2355:x1875536389437440:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651145.615399:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651145.615406:0:11151:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 21 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.615435:0:11151:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 21 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.615455:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b2 expref: 21 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.615471:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:3.0:1788651145.615476:0:11151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.615486:0:11151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.615502:0:11151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.615531:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651145.615584:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:2355:x1875536389437440:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 201us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.615592:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00010000:00010000:0.0:1788651145.615648:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615656:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615684:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615690:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615696:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615700:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ce00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651145.615704:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615723:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615739:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:0.0:1788651145.615742:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788651145.615745:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.615751:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56ce00/0x84a2fba88797817a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.615784:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11609:x1875536389437312:12345-192.168.203.21@tcp:55:lhsmtool_posix.0 Request processed in 3626us (3970us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788651145.615791:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 229 00000100:00100000:1.0:1788651145.626181:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.626316:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389437568 00000100:00100000:3.0:1788651145.626327:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389437568 00000100:00100000:3.0:1788651145.626394:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:3.0:1788651145.626406:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2353:x1875536389437568:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.626454:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.626492:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.626502:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651145.626506:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651145.626511:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.626548:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 8 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.626563:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 8 pid: 6675 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.626578:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408292480:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651145.626780:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be48b06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651145.631287:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1875536408292480:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651145.631316:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.633545:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651145.633671:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389437696 00000100:00100000:0.0:1788651145.633682:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389437696 00010000:00010000:0.0:1788651145.633739:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 9 pid: 6675 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.633783:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:0.0:1788651145.633793:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+9:2356:x1875536389437696:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651145.633809:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651145.633832:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 9 pid: 6675 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.633847:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 9 pid: 6675 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.633869:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007639e886/0x84a2fba88797815e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ce expref: 9 pid: 6675 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.633904:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651145.633908:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651145.633913:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.633923:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.633957:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651145.633989:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634011:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.634013:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389437696:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 220us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651145.634026:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00010000:00010000:3.0:1788651145.634055:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634065:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634072:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634079:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651145.634084:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634093:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634417:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.634427:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978181 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.634483:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2353:x1875536389437568:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 8078us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.634491:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 70 00000100:00100000:1.0:1788651145.644331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.644414:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389437952 00000100:00100000:3.0:1788651145.644426:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389437952 00000100:00100000:3.0:1788651145.644485:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 230 00000100:00100000:3.0:1788651145.644494:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11609:x1875536389437952:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788651145.644577:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644593:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644605:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644807:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644819:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644827:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644861:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.644948:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 20 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.644964:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408292608:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651145.645059:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be48b06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651145.648083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651145.648163:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389438080 00000100:00100000:2.0:1788651145.648182:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389438080 00010000:00010000:2.0:1788651145.648224:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 21 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651145.648282:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:2.0:1788651145.648293:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:2356:x1875536389438080:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651145.648309:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651145.648317:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 21 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.648329:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 21 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.648350:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:2.0:1788651145.648356:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.648366:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.648372:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3b9 expref: 21 pid: 5843 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651145.648375:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.648401:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408292608:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651145.648405:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651145.648423:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.648434:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.648441:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651145.648462:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:2356:x1875536389438080:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 169us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651145.648469:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00000001:00080000:3.0:1788651145.648885:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788651145.649019:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788651145.649064:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788651145.649220:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408292736:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788651145.649289:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651145.649320:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651145.649334:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408292736 00000100:00100000:2.0:1788651145.649340:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408292736 00000100:00100000:2.0:1788651145.649375:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788651145.649380:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875536408292736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788651145.649448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875536408292736:12345-0@lo:1000:mdt00_003.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651145.649453:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788651145.649477:0:5871:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788651145.649494:0:5871:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788651145.649510:0:5871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be75407800, transno 4294967321 00000004:00080000:3.0:1788651145.649523:0:5871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be75405880, transno 4294967322 00000100:00100000:3.0:1788651145.649529:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408292736:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788651145.649959:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788651145.650019:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408292864:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788651145.650050:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651145.650084:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c52180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651145.650188:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408292864 00000100:00100000:0.0:1788651145.650194:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408292864 00000100:00100000:0.0:1788651145.650235:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788651145.650244:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5871:x1875536408292864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788651145.650532:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5871:x1875536408292864:12345-0@lo:1000:mdt00_003.0 Request processed in 289us (481us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788651145.650539:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788651145.650596:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875536408292864:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788651145.650630:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650640:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650647:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650652:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.650657:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650664:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650678:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be51759400) 00010000:00010000:3.0:1788651145.650682:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651145.650687:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650693:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba88797818f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650734:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650740:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650745:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650763:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.650766:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650772:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650781:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651145.650784:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651145.650790:0:5871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650800:0:5871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650809:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.650832:0:5871:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.650843:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408292992:192.168.203.21@tcp:105: 00000100:00100000:3.0:1788651145.650904:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45c52180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651145.655366:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875536408292992:192.168.203.21@tcp:105: 00010000:00010000:3.0:1788651145.655400:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655431:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba8879780d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655465:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655478:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655489:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655500:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655506:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655513:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655518:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.655522:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655529:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655540:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651145.655543:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651145.655547:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655560:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba887978196 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655571:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655577:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655583:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655588:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651145.655591:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655597:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655604:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651145.655606:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651145.655609:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.655614:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba887978188 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.655905:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:11609:x1875536389437952:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 11409us (11580us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788651145.655915:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 230 00000020:00080000:3.0:1788651145.655933:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788651145.656066:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651145.656071:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651145.656736:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788651145.656745:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651145.660037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.660369:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389438208 00000100:00100000:1.0:1788651145.660379:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389438208 00000100:00100000:0.0:1788651145.660399:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.660423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389438464 00000100:00100000:1.0:1788651145.660425:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389438464 00000100:00100000:1.0:1788651145.660446:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1788651145.660456:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11608:x1875536389438208:12345-192.168.203.21@tcp:49:lfs.0 00000100:00100000:1.0:1788651145.660731:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+24:11608:x1875536389438208:12345-192.168.203.21@tcp:49:lfs.0 Request processed in 276us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651145.660739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:1.0:1788651145.660757:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 62 00000100:00100000:1.0:1788651145.660764:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+23:11609:x1875536389438464:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788651145.661365:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788651145.661441:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788651145.661483:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.661496:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.661505:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.661511:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.661515:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.661518:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.661543:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651145.661720:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788651145.661729:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+25:11609:x1875536389438464:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 963us (1327us total) trans 4294967514 rc 0/0 00010000:00010000:0.0:1788651145.661731:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.661736:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 62 00000020:00080000:1.0:1788651145.661740:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788651145.661750:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651145.661755:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.661765:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.661779:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:0.0:1788651145.661783:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788651145.661788:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.661794:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba88797819d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651145.661814:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651145.661816:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651145.661817:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651145.666064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651145.666216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389438720 00000100:00100000:2.0:1788651145.666227:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389438720 00000100:00100000:2.0:1788651145.666283:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 231 00000100:00100000:2.0:1788651145.666294:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+25:11608:x1875536389438720:12345-192.168.203.21@tcp:58:lfs.0 00000040:00080000:2.0:1788651145.666556:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788651145.666648:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+25:11608:x1875536389438720:12345-192.168.203.21@tcp:58:lfs.0 Request processed in 355us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651145.666656:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 231 00000100:00100000:2.0:1788651145.714965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651145.715540:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389438848 00000100:00100000:1.0:1788651145.715551:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389438848 00000100:00100000:1.0:1788651145.715979:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 232 00000100:00100000:1.0:1788651145.715992:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+25:11611:x1875536389438848:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651145.716017:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651145.716037:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879781a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3d5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716150:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716164:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716174:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716187:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716193:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716199:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716422:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716433:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716441:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716472:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.716484:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 26 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651145.716498:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408293120:192.168.203.21@tcp:104: 00000100:00100000:1.0:1788651145.716595:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be65b99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651145.722628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651145.722779:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389439104 00000100:00100000:2.0:1788651145.722791:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389439104 00000100:00100000:2.0:1788651145.722856:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:2.0:1788651145.722867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:5591:x1875536389439104:12345-192.168.203.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788651145.723084:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:5591:x1875536389439104:12345-192.168.203.21@tcp:35:ldlm_bl.0 Request processed in 218us (463us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788651145.723092:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 63 00000100:00100000:1.0:1788651145.723688:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875536408293120:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651145.723722:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651145.726601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651145.726732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389439232 00000100:00100000:3.0:1788651145.726743:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389439232 00010000:00010000:3.0:1788651145.726786:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 28 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651145.726827:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:3.0:1788651145.726837:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:2355:x1875536389439232:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651145.726852:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651145.726858:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 28 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.726872:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 28 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.726893:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879780c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c396 expref: 28 pid: 5841 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.726909:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651145.726914:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.726924:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.726931:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651145.726963:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651145.727036:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:2355:x1875536389439232:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 199us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651145.727043:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00010000:00010000:1.0:1788651145.727152:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651145.727200:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788651145.727212:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651145.727232:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727243:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727252:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727258:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727264:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727269:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651145.727273:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727280:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727298:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:1.0:1788651145.727301:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651145.727305:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727311:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba8879781ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727322:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727337:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727342:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727347:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9ca00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651145.727350:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727356:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727364:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93be58f79600) 00010000:00010000:1.0:1788651145.727366:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651145.727369:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727375:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9ca00/0x84a2fba8879781b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727411:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879781a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3d5 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727423:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3d5 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651145.727430:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:1.0:1788651145.727432:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651145.727440:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c000, rc 0) 00000100:00100000:1.0:1788651145.727466:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11611:x1875536389438848:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 11477us (12509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651145.727473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 232 00000040:00080000:1.0:1788651146.353429:0:12545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651146.353440:0:12545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651146.353565:0:12545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788651146.353572:0:12545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788651146.566688:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651146.692341:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651146.692351:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651146.692409:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788651146.692429:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651146.692559:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408293248:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651146.692674:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be45d6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651146.702632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651146.702808:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389439360 00000100:00100000:3.0:1788651146.702819:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389439360 00000100:00100000:3.0:1788651146.702878:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 233 00000100:00100000:3.0:1788651146.702890:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:11623:x1875536389439360:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651146.702927:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651146.703031:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+27:11623:x1875536389439360:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 143us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651146.703039:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 233 00000100:00100000:1.0:1788651146.707710:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875536408293248:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788651146.712964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651146.713179:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389439616 00000100:00100000:3.0:1788651146.713196:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389439616 00000100:00100000:3.0:1788651146.713291:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 234 00000100:00100000:3.0:1788651146.713303:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+26:11623:x1875536389439616:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651146.713328:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651146.713366:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879781c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3dc expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.713722:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.713742:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.713769:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651146.713783:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788651146.726261:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d600/0x84a2fba8879781c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3dc expref: 29 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651146.726595:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3dc expref: 28 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651146.726630:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:2.0:1788651146.726633:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651146.726638:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d200, rc 0) 00000100:00100000:2.0:1788651146.726740:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:11623:x1875536389439616:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 13437us (13784us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788651146.726750:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 234 00000100:00100000:0.0:1788651146.731620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651146.731840:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651146.731936:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389439872 00000100:00100000:3.0:1788651146.731948:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389439872 00000100:00100000:3.0:1788651146.732011:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 235 00000100:00100000:3.0:1788651146.732023:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:11623:x1875536389439872:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788651146.732138:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732157:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732169:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732482:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732490:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732497:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732503:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651146.732507:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732515:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732538:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651146.732542:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651146.732546:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651146.732559:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651146.732712:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:11623:x1875536389439872:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 679us (1091us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788651146.733853:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389440000 00000100:00100000:1.0:1788651146.733866:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389440000 00000100:00100000:1.0:1788651146.734089:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651146.734100:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+30:2356:x1875536389440000:12345-192.168.203.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788651146.734318:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 235 00010000:00010000:1.0:1788651146.734603:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651146.734626:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3dc expref: 29 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651146.734644:0:11151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:1.0:1788651146.734649:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1788651146.735344:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651146.735349:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788651146.735866:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:2356:x1875536389440000:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 1764us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651146.735877:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000040:00080000:3.0:1788651146.736167:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788651146.736651:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651146.740847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651146.740947:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389440256 00000100:00100000:2.0:1788651146.740958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389440256 00000100:00100000:3.0:1788651146.741092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 64 00000100:00100000:3.0:1788651146.741343:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+28:11623:x1875536389440256:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788651146.743138:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:11623:x1875536389440256:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 2004us (2267us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788651146.743149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 64 00000001:00080000:1.0:1788651147.177513:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788651147.177527:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788651147.177532:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1788651147.588362:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651148.104403:0:12598:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651148.104412:0:12598:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651148.104475:0:12598:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788651148.104482:0:12598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651148.173674:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408293632:0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.173751:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651148.173808:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651148.173814:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408293760:0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.173838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651148.174082:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408293376:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.174130:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651148.174153:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408293888:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.174176:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651148.174195:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788651148.174201:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408293504:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.174223:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651148.174239:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408294016:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.174259:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651148.174283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408293632 00000100:00100000:0.0:1788651148.174290:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408293632 00000100:00100000:0.0:1788651148.174337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408293888 00000100:00100000:0.0:1788651148.174340:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408293888 00000100:00100000:0.0:1788651148.174355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788651148.174362:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408293632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.174415:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408293632:12345-0@lo:400:kworker.0 Request processed in 53us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651148.174422:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788651148.174438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408293504 00000100:00100000:0.0:1788651148.174440:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408293504 00000100:00100000:0.0:1788651148.174454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788651148.174460:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408293888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788651148.174812:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651148.174980:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408293888:12345-0@lo:400:kworker.0 Request processed in 518us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651148.174987:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788651148.175122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788651148.175132:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408293504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.175161:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408293504:12345-0@lo:400:kworker.0 Request processed in 32us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651148.175167:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788651148.175188:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408293760 00000100:00100000:2.0:1788651148.175191:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408293760 00000100:00100000:2.0:1788651148.175218:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294016 00000100:00100000:2.0:1788651148.175225:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294016 00000100:00100000:2.0:1788651148.175244:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788651148.175250:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408293760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.175275:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408293760:12345-0@lo:400:kworker.0 Request processed in 26us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651148.175281:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788651148.175290:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788651148.175295:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408294016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.175314:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875536408294016:12345-0@lo:400:kworker.0 Request processed in 19us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651148.175319:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788651148.175332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651148.175335:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651148.175358:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788651148.175363:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788651148.175382:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be7540f800, transno 4294967310 00000100:00100000:2.0:1788651148.175392:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408293760:0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.175403:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408293632:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.175575:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408293504:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.175585:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408294016:0@lo:400:kworker.0 00000100:00100000:0.0:1788651148.175593:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788651148.176082:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408293376 00000100:00100000:3.0:1788651148.176088:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408293376 00000100:00100000:3.0:1788651148.176152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788651148.176159:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651148.176202:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408293376:12345-0@lo:400:kworker.0 Request processed in 44us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651148.176208:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788651148.176256:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408293376:0@lo:400:kworker.0 00000100:00100000:2.0:1788651148.231524:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651148.231594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389440512 00000100:00100000:3.0:1788651148.231604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389440512 00000100:00100000:3.0:1788651148.231672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 236 00000100:00100000:3.0:1788651148.231682:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+29:11643:x1875536389440512:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:3.0:1788651148.231721:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651148.231743:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.231840:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba8879781e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.231853:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba8879781e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.231866:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba8879781e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651148.231887:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788651148.231994:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c000/0x84a2fba8879781dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3e3 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.232021:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba8879781e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3e3 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.232030:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651148.232034:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651148.232037:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d400, rc 0) 00000100:00100000:3.0:1788651148.232084:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:11643:x1875536389440512:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 404us (570us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788651148.232090:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 236 00000100:00080000:2.0:1788651148.232629:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651148.236068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651148.236305:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389440640 00000100:00100000:3.0:1788651148.236316:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389440640 00000100:00100000:3.0:1788651148.236381:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 237 00000100:00100000:3.0:1788651148.236410:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:11643:x1875536389440640:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:3.0:1788651148.236501:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236518:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236529:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236561:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236568:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236575:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236588:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651148.236593:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236601:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236622:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651148.236625:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651148.236631:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651148.236643:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d200/0x84a2fba8879781f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651148.236745:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:11643:x1875536389440640:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 339us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651148.236753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 237 00000100:00100000:3.0:1788651148.306525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651148.306733:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389440768 00000100:00100000:2.0:1788651148.306746:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389440768 00000100:00100000:2.0:1788651148.306822:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00100000:2.0:1788651148.306833:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2356:x1875536389440768:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:2.0:1788651148.306852:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651148.306884:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f4007a/0x84a2fba8879781f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3ea expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651148.306912:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ca689, atime: 0x6a9ca688, ctime: 0x6a9ca689, blocks: 0xb 00010000:00010000:2.0:1788651148.306932:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1788651148.306937:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651148.306946:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f4007a/0x84a2fba8879781f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ea expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651148.306965:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2f4007a/0x84a2fba8879781f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ea expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651148.306979:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ac00, rc 0) 00000100:00100000:2.0:1788651148.307034:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2356:x1875536389440768:12345-192.168.203.21@tcp:101:cat.0 Request processed in 203us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651148.307041:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 71 00000100:00080000:1.0:1788651148.307284:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651148.314779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651148.314887:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389440896 00000100:00100000:3.0:1788651148.314901:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389440896 00002000:00100000:3.0:1788651148.314955:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93be7540e680 x1875536389440896/t0(0) o3->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:289/0 lens 488/0 e 0 to 0 dl 1788651159 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651148.314966:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be7540e680 with x1875536389440896 ext(0->4095) 00002000:00010000:3.0:1788651148.314972:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be7540e680 00000100:00100000:3.0:1788651148.315007:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1788651148.315028:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389440896:12345-192.168.203.21@tcp:3:cat.0 00000100:00100000:3.0:1788651148.315749:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2355:x1875536389440896:12345-192.168.203.21@tcp:3:cat.0 Request processed in 728us (975us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788651148.315759:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00002000:00100000:3.0:1788651148.315769:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93be7540e680 x1875536389440896/t0(0) o3->f051ebe0-0677-425e-9b9b-54befcd9fd1c@192.168.203.21@tcp:289/0 lens 488/4536 e 0 to 0 dl 1788651159 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651148.315776:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93be7540e680 with x1875536389440896 ext(0->4095) 00002000:00010000:3.0:1788651148.315780:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93be7540e680 00010000:00010000:0.0:1788651148.612275:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651148.682078:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408294144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651148.682226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651148.682337:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294144 00000100:00100000:1.0:1788651148.682346:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294144 00000100:00100000:1.0:1788651148.682405:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788651148.682416:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408294144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651148.682452:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651148.685559:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875536408294144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3135us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651148.685574:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788651148.685739:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408294144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651149.636415:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651150.214332:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651150.214356:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408294272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651150.214428:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651150.214670:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294272 00000100:00100000:3.0:1788651150.214688:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294272 00000100:00100000:3.0:1788651150.214754:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788651150.214765:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408294272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651150.214800:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651150.214881:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408294272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651150.214889:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788651150.215132:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408294272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788651150.215272:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651150.302270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651150.302311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651150.302351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651150.302376:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651150.302399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651150.302426:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441536 00000100:00100000:0.0:1788651150.302437:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441536 00000100:00100000:0.0:1788651150.302501:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441152 00000100:00100000:0.0:1788651150.302505:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441152 00000100:00100000:0.0:1788651150.302523:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 147 00000100:00100000:0.0:1788651150.302533:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389441536:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651150.302611:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:2354:x1875536389441536:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651150.302619:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 147 00000100:00100000:0.0:1788651150.302637:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 148 00000100:00100000:0.0:1788651150.302644:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:2354:x1875536389441152:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651150.302671:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+31:2354:x1875536389441152:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651150.302691:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 148 00000100:00100000:1.0:1788651150.303816:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441280 00000100:00100000:1.0:1788651150.303828:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441280 00000100:00100000:1.0:1788651150.303876:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441408 00000100:00100000:1.0:1788651150.303880:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441408 00000100:00100000:1.0:1788651150.303920:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:1.0:1788651150.303929:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389441280:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651150.303985:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2354:x1875536389441280:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 58us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651150.303992:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:1.0:1788651150.304007:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:1.0:1788651150.304014:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2354:x1875536389441408:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651150.304038:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+8:2354:x1875536389441408:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 26us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651150.304044:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00080000:1.0:1788651150.304093:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651150.304097:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651150.304099:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651150.305655:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441024 00000100:00100000:3.0:1788651150.305668:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441024 00000100:00100000:3.0:1788651150.305801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 291 00000100:00100000:3.0:1788651150.305810:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389441024:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651150.305893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2354:x1875536389441024:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 84us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651150.305900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 291 00010000:00010000:2.0:1788651150.660386:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788651150.762240:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788651150.762257:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788651150.774045:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1788651150.774072:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788651150.774135:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1788651150.774393:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788651150.774654:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788651150.774678:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93be45c52840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788651150.774683:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be7580a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93be45c52f00 00000020:00080000:3.0:1788651150.774686:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93be7580a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93be6d54e000 00000020:00080000:1.0:1788651150.774783:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788651150.774967:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000040:00080000:3.0:1788651150.852957:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651150.852966:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651150.853421:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788651150.853429:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788651151.684599:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651152.709427:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651152.885605:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651152.885651:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441664 00000100:00100000:1.0:1788651152.885673:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441664 00000100:00100000:1.0:1788651152.885748:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00100000:1.0:1788651152.886308:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:11288:x1875536389441664:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788651152.886425:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:11288:x1875536389441664:12345-192.168.203.21@tcp:60:lhsmtool_posix.0 Request processed in 124us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651152.886434:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 238 00000100:00080000:1.0:1788651152.886904:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651152.896401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651152.896700:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389441920 00000100:00100000:3.0:1788651152.896712:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389441920 00000100:00100000:3.0:1788651152.896793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:3.0:1788651152.896805:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:11288:x1875536389441920:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651152.897538:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:11288:x1875536389441920:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 730us (1144us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788651152.897548:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:1.0:1788651153.085670:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651153.085852:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442048 00000100:00100000:2.0:1788651153.085866:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442048 00000100:00100000:2.0:1788651153.085955:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 239 00000100:00100000:2.0:1788651153.085976:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+5:12094:x1875536389442048:12345-192.168.203.21@tcp:101:lsof.0 00010000:00010000:2.0:1788651153.086002:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788651153.086241:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788651153.086402:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879781ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c3f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651153.086626:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978206 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651153.086638:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651153.086651:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651153.086693:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651153.086696:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651153.086718:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651153.086742:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba8879781ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3f1 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651153.086761:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3f1 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651153.086768:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:2.0:1788651153.086771:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651153.086775:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ba00, rc 0) 00000100:00100000:2.0:1788651153.086849:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:12094:x1875536389442048:12345-192.168.203.21@tcp:101:lsof.0 Request processed in 884us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651153.086857:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 239 00000100:00100000:3.0:1788651153.284935:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408294400:0@lo:400:kworker.0 00000100:00100000:3.0:1788651153.285065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651153.285299:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408294528:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.285342:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651153.285403:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294528 00000100:00100000:2.0:1788651153.285412:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294528 00000100:00100000:2.0:1788651153.285456:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788651153.285465:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408294528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.285528:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408294528:12345-0@lo:400:kworker.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651153.285535:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788651153.285588:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408294528:0@lo:400:kworker.0 00000100:00100000:1.0:1788651153.285849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294400 00000100:00100000:1.0:1788651153.285854:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294400 00000100:00100000:1.0:1788651153.285898:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788651153.285905:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408294400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286165:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408294656:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286195:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651153.286223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651153.286229:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408294784:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286252:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651153.286292:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408295040:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651153.286341:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651153.286345:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408294912:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286363:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651153.286385:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294784 00000100:00100000:2.0:1788651153.286389:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294784 00000100:00100000:2.0:1788651153.286422:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295040 00000100:00100000:2.0:1788651153.286425:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295040 00000100:00100000:2.0:1788651153.286446:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788651153.286452:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286719:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408294784:12345-0@lo:400:kworker.0 Request processed in 266us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651153.286726:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788651153.286751:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788651153.286757:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408295040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286790:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408295040:12345-0@lo:400:kworker.0 Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651153.286796:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788651153.286815:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651153.286820:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651153.286842:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408294784:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286863:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788651153.286869:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788651153.286884:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408295040:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294656 00000100:00100000:2.0:1788651153.286902:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294656 00000100:00100000:2.0:1788651153.286928:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408294912 00000100:00100000:2.0:1788651153.286931:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408294912 00000100:00100000:2.0:1788651153.286959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788651153.286966:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408294656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.286997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408294656:12345-0@lo:400:kworker.0 Request processed in 33us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651153.287003:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788651153.287014:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651153.287019:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.287047:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408294912:12345-0@lo:400:kworker.0 Request processed in 28us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651153.287053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788651153.287068:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651153.287094:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408294656:0@lo:400:kworker.0 00000100:00100000:2.0:1788651153.287143:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408294912:0@lo:400:kworker.0 00000100:00100000:1.0:1788651153.287726:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408294400:12345-0@lo:400:kworker.0 Request processed in 1818us (2659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651153.287736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788651153.287827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408294400:0@lo:400:kworker.0 00010000:00010000:2.0:1788651153.733968:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651153.797269:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651153.797288:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408295168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651153.797350:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651153.797461:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295168 00000100:00100000:3.0:1788651153.797470:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295168 00000100:00100000:3.0:1788651153.797529:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788651153.797542:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408295168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651153.797577:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651153.797626:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408295168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651153.797633:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788651153.797696:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408295168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788651154.756783:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651155.333584:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408295296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651155.333668:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651155.333771:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295296 00000100:00100000:0.0:1788651155.333779:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295296 00000100:00100000:0.0:1788651155.333843:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788651155.333855:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408295296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651155.333889:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651155.333932:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408295296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651155.333938:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788651155.334055:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651155.334096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408295296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651155.425196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651155.425234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651155.425257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651155.425272:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651155.425289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651155.425312:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442432 00000100:00100000:2.0:1788651155.425322:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442432 00000100:00100000:2.0:1788651155.425371:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442560 00000100:00100000:2.0:1788651155.425373:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442560 00000100:00100000:2.0:1788651155.425393:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:2.0:1788651155.425402:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389442432:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651155.425470:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2355:x1875536389442432:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651155.425477:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:2.0:1788651155.425492:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:2.0:1788651155.425498:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389442560:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651155.425530:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2355:x1875536389442560:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651155.425537:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:2.0:1788651155.425551:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442688 00000100:00100000:2.0:1788651155.425554:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442688 00000100:00100000:2.0:1788651155.425573:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442304 00000100:00100000:2.0:1788651155.425575:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442304 00000100:00100000:2.0:1788651155.425591:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 152 00000100:00100000:2.0:1788651155.425596:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2355:x1875536389442688:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651155.425617:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2355:x1875536389442688:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 21us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651155.425623:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 152 00000100:00100000:2.0:1788651155.425632:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 153 00000100:00100000:2.0:1788651155.425637:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:2355:x1875536389442304:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651155.425671:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:2355:x1875536389442304:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 35us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651155.425677:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 153 00000100:00080000:2.0:1788651155.425695:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651155.425699:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651155.425701:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651155.426592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442176 00000100:00100000:3.0:1788651155.426602:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442176 00000100:00100000:3.0:1788651155.426657:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 293 00000100:00100000:3.0:1788651155.426665:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389442176:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651155.426714:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2355:x1875536389442176:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 50us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651155.426721:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 293 00010000:00010000:3.0:1788651155.784840:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788651155.837740:0:12799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:32:35 (1788651155) 00000020:00080000:3.0:1788651155.903772:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788651155.903805:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788651155.903911:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788651155.903924:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788651156.804416:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651157.829908:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651158.404492:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.404590:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651158.404683:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408296064:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.404712:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651158.404773:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788651158.404779:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408295424:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.404811:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651158.404833:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408295936:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.404859:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651158.404888:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.404914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651158.404935:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651158.404940:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408295680:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.404964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651158.404995:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296064 00000100:00100000:2.0:1788651158.405003:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296064 00000100:00100000:2.0:1788651158.405062:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295808 00000100:00100000:2.0:1788651158.405065:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295808 00000100:00100000:2.0:1788651158.405089:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788651158.405099:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408296064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405182:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408296064:12345-0@lo:400:kworker.0 Request processed in 84us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651158.405190:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788651158.405210:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788651158.405217:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408295808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405250:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408295808:12345-0@lo:400:kworker.0 Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651158.405256:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788651158.405275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295552 00000100:00100000:2.0:1788651158.405278:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295552 00000100:00100000:2.0:1788651158.405304:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295936 00000100:00100000:2.0:1788651158.405315:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295936 00000100:00100000:2.0:1788651158.405332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295680 00000100:00100000:2.0:1788651158.405334:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295680 00000100:00100000:2.0:1788651158.405348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788651158.405354:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408295552:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651158.405392:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788651158.405404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788651158.405409:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7586ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408295936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405436:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7586ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408295936:12345-0@lo:400:kworker.0 Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651158.405441:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788651158.405452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788651158.405457:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408295680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405480:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408295680:12345-0@lo:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651158.405485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1788651158.405508:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651158.405512:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651158.405515:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651158.405555:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d517b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408295680:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405567:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405599:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408295936:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788651158.405644:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788651158.405743:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408295424 00000100:00100000:1.0:1788651158.405749:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408295424 00000100:00100000:1.0:1788651158.405788:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788651158.405796:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408295424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651158.405844:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3309:x1875536408295424:12345-0@lo:400:kworker.0 Request processed in 49us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651158.405849:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788651158.405881:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be0363c2-36c6-418a-b340-2685dfcc42ae:3309:1875536408295424:0@lo:400:kworker.0 00010000:00010000:3.0:1788651158.852601:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651158.916983:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be42e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408296192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651158.917062:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651158.917218:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296192 00000100:00100000:0.0:1788651158.917227:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296192 00000100:00100000:0.0:1788651158.917286:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788651158.917296:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408296192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651158.917343:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651158.917399:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408296192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651158.917415:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651158.917578:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be42e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408296192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788651159.879908:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651159.960457:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651159.960564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389442944 00000100:00100000:0.0:1788651159.960576:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389442944 00000100:00100000:0.0:1788651159.960671:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00100000:0.0:1788651159.960683:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+18:12315:x1875536389442944:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:0.0:1788651159.961053:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:12315:x1875536389442944:12345-192.168.203.21@tcp:35:umount.0 Request processed in 372us (603us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788651159.961061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 66 00000100:00080000:2.0:1788651159.961194:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651159.966663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651159.966759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389443200 00000100:00100000:3.0:1788651159.966772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389443200 00000100:00100000:3.0:1788651159.966849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:3.0:1788651159.966860:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+19:12315:x1875536389443200:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:3.0:1788651159.967537:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:12315:x1875536389443200:12345-192.168.203.21@tcp:35:umount.0 Request processed in 675us (881us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788651159.967546:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 67 00000100:00100000:1.0:1788651159.976855:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651159.977096:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389443456 00000100:00100000:3.0:1788651159.977135:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389443456 00000100:00100000:3.0:1788651159.977207:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:3.0:1788651159.977219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be57bae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+20:12315:x1875536389443456:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:3.0:1788651159.977481:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be57bae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:12315:x1875536389443456:12345-192.168.203.21@tcp:35:umount.0 Request processed in 263us (635us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788651159.977489:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 68 00000100:00100000:2.0:1788651159.985959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651159.987274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389443712 00000100:00100000:3.0:1788651159.987289:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389443712 00000100:00100000:3.0:1788651159.987365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:3.0:1788651159.987377:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+21:12315:x1875536389443712:12345-192.168.203.21@tcp:35:umount.0 00000100:00100000:3.0:1788651159.988056:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:12315:x1875536389443712:12345-192.168.203.21@tcp:35:umount.0 Request processed in 679us (2103us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788651159.988082:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1788651159.998818:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651159.998859:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651159.998950:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389443840 00000100:00100000:2.0:1788651159.998962:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389443840 00000100:00100000:2.0:1788651159.999026:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389443968 00000100:00100000:2.0:1788651159.999029:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389443968 00000100:00100000:2.0:1788651159.999062:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:2.0:1788651159.999071:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+14:2356:x1875536389443840:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651159.999088:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651159.999132:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9ce00/0x84a2fba88797727e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf7c expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651159.999149:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651159.999203:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+13:2356:x1875536389443840:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 133us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651159.999210:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:2.0:1788651159.999229:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:2.0:1788651159.999235:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:2356:x1875536389443968:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651159.999243:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651159.999252:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be41670c00/0x84a2fba8879771e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf44 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651159.999262:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651159.999281:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:2356:x1875536389443968:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 46us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651159.999303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1788651160.003798:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651160.003879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651160.004023:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389444480 00000100:00100000:2.0:1788651160.004034:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389444480 00000100:00100000:2.0:1788651160.004126:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1788651160.004138:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:2354:x1875536389444480:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651160.004152:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651160.004169:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a600/0x84a2fba887977468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c047 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651160.004185:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651160.004234:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2354:x1875536389444480:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 98us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651160.004242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1788651160.005049:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389444352 00000100:00100000:0.0:1788651160.005058:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389444352 00000100:00100000:0.0:1788651160.005162:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00100000:0.0:1788651160.005172:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2352:x1875536389444352:12345-192.168.203.21@tcp:9:umount.0 00000020:00000080:0.0:1788651160.005200:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879777b7 00000020:00010000:0.0:1788651160.005208:0:6674:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93be45402800: total 0 00000100:00080000:0.0:1788651160.005213:0:6674:0:(import.c:65:import_set_state_nolock()) ffff93be45407000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788651160.005252:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788651160.005565:0:8436:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93be45402800: total 0 00010000:00010000:1.0:1788651160.005619:0:8436:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93be45402800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788651160.005680:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f4007a/0x84a2fba8879781f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3ea expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651160.005712:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794c1561/0x84a2fba887977b5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c21c expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651160.005726:0:8436:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93be45402800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788651160.005738:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651160.005740:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651160.005742:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651160.006083:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+2:2352:x1875536389444352:12345-192.168.203.21@tcp:9:umount.0 Request processed in 911us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651160.006091:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 72 00000100:00080000:2.0:1788651160.006579:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651160.013060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651160.013169:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389444608 00000100:00100000:2.0:1788651160.013190:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389444608 00000100:00100000:2.0:1788651160.013274:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:2.0:1788651160.013286:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+5:2352:x1875536389444608:12345-192.168.203.21@tcp:9:umount.0 00000020:00000080:2.0:1788651160.013317:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887977556 00000100:00080000:2.0:1788651160.013326:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93be74ff7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788651160.013367:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788651160.013749:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788651160.013824:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651160.014035:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f051ebe0-0677-425e-9b9b-54befcd9fd1c+2:2352:x1875536389444608:12345-192.168.203.21@tcp:9:umount.0 Request processed in 748us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651160.014044:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:1.0:1788651160.029949:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651160.030275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389445632 00000100:00100000:2.0:1788651160.030287:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389445632 00000100:00100000:2.0:1788651160.030383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 240 00000100:00100000:2.0:1788651160.030406:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+22:2352:x1875536389445632:12345-192.168.203.21@tcp:39:umount.0 00000020:00000080:2.0:1788651160.030442:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879771f2 00000020:00010000:2.0:1788651160.030752:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93be6d7b2000: total 0 00000100:00080000:2.0:1788651160.030759:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788651160.030790:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788651160.031343:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93be6d7b2000: total 0 00010000:00010000:3.0:1788651160.031390:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93be6d7b2000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788651160.031596:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651160.031600:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651160.031619:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba8879781b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3d5 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031641:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:3.0:1788651160.031705:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651160.031713:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887977bbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c238 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031731:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651160.031734:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651160.031738:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860c00/0x84a2fba887977b1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c207 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031751:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651160.031753:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651160.031756:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56da00/0x84a2fba887977b45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c215 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031767:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651160.031769:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788651160.031772:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860000/0x84a2fba887977eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c311 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031802:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651160.031805:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651160.031809:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56d400/0x84a2fba8879781e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3e3 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031822:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651160.031824:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788651160.031827:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be41670200/0x84a2fba887977819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c143 expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031840:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93be449ae600) 00010000:00010000:3.0:1788651160.031842:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651160.031846:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618a000/0x84a2fba8879774bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c055 expref: 14 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031863:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93be449aec00) 00010000:00010000:3.0:1788651160.031865:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788651160.031869:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b600/0x84a2fba887977bd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c23f expref: 13 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031881:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93be58f79500) 00010000:00010000:3.0:1788651160.031883:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651160.031887:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56dc00/0x84a2fba887977a3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c1cf expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031899:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93be44b46500) 00010000:00010000:3.0:1788651160.031901:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788651160.031911:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860200/0x84a2fba88797752c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c071 expref: 11 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031926:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93be44b46900) 00010000:00010000:3.0:1788651160.031928:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651160.031931:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c200/0x84a2fba8879780d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c39d expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031944:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be449ae300) 00010000:00010000:3.0:1788651160.031946:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651160.031950:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba8879774d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c05c expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651160.031961:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93be6d7b2000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788651160.031974:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651160.031976:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651160.031978:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651160.032033:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f051ebe0-0677-425e-9b9b-54befcd9fd1c+7:2352:x1875536389445632:12345-192.168.203.21@tcp:39:umount.0 Request processed in 1638us (2091us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788651160.032044:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 240 00000040:00080000:1.0:1788651160.068437:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651160.068447:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651160.068888:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788651160.068896:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651160.452588:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be6d3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408296320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651160.452677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651160.452860:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296320 00000100:00100000:0.0:1788651160.452869:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296320 00000100:00100000:0.0:1788651160.452979:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651160.452990:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bc32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408296320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651160.453024:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651160.453085:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bc32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408296320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651160.453093:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788651160.453367:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be6d3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408296320:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651160.453428:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651160.542392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651160.542504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389445760 00000100:00100000:2.0:1788651160.542515:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389445760 00000100:00100000:2.0:1788651160.542612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 157 00000100:00100000:2.0:1788651160.542625:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2354:x1875536389445760:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651160.542716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2354:x1875536389445760:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 93us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651160.542723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 157 00000100:00080000:0.0:1788651160.542890:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651160.900775:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788651161.041159:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00100000:0.0:1788651161.041179:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000001:00080000:0.0:1788651161.041185:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788651161.041198:0:5863:0:(genops.c:885:class_export_put()) final put ffff93be6d7b2000/f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:0.0:1788651161.041217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6d7b2000/f051ebe0-0677-425e-9b9b-54befcd9fd1c for lustre-MDT0000 00000020:00000080:0.0:1788651161.041272:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be6d7b1800 for lustre-MDT0000 00000001:00100000:0.0:1788651161.047692:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:0.0:1788651161.047702:0:7633:0:(genops.c:885:class_export_put()) final put ffff93be45402800/f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:0.0:1788651161.047725:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be45402800/f051ebe0-0677-425e-9b9b-54befcd9fd1c for lustre-OST0001 00000020:00000080:0.0:1788651161.047762:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be45407000 for lustre-OST0001 00010000:00010000:1.0:1788651161.924322:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651162.047726:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651162.047769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651162.047872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651162.048531:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389445888 00000100:00100000:0.0:1788651162.048551:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389445888 00000100:00100000:0.0:1788651162.048622:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389446144 00000100:00100000:0.0:1788651162.048626:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389446144 00000100:00100000:0.0:1788651162.048640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389446016 00000100:00100000:0.0:1788651162.048643:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389446016 00000100:00100000:0.0:1788651162.048662:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1788651162.048672:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+12:2356:x1875536389445888:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651162.048688:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651162.048708:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9d000/0x84a2fba8879772c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf91 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651162.048725:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651162.048776:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+11:2356:x1875536389445888:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 106us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651162.048784:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1788651162.048800:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:0.0:1788651162.048820:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2356:x1875536389446144:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651162.048828:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651162.048837:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be6d56c600/0x84a2fba887977461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c040 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651162.049135:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:1.0:1788651162.049146:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+10:2356:x1875536389446016:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651162.049155:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651162.049164:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40030200/0x84a2fba8879772cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bfbb expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651162.049180:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651162.049202:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+9:2356:x1875536389446016:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 59us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651162.049209:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00010000:00010000:0.0:1788651162.049399:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651162.049428:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+7:2356:x1875536389446144:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 608us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651162.049436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:1.0:1788651162.060056:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651162.060799:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389446400 00000100:00100000:2.0:1788651162.060811:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389446400 00000100:00100000:2.0:1788651162.060904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 241 00000100:00100000:2.0:1788651162.060915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+6:2352:x1875536389446400:12345-192.168.203.21@tcp:39:umount.0 00000020:00000080:2.0:1788651162.060954:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879772d9 00000020:00010000:2.0:1788651162.060962:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93be7ff88800: total 0 00000100:00080000:2.0:1788651162.060968:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93be7ff8b800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788651162.060988:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:2.0:1788651162.060992:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1788651162.061016:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93be7ff88800: total 0 00010000:00010000:0.0:1788651162.061021:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651162.061063:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93be7ff88800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788651162.061097:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be449ae200) 00010000:00010000:0.0:1788651162.061101:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651162.061130:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978206 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c3f1 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651162.061157:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93be7ff88800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788651162.061172:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651162.061175:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651162.061177:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651162.061493:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d7bda642-03c1-4a62-a15f-35e85e686a7f+3:2352:x1875536389446400:12345-192.168.203.21@tcp:39:umount.0 Request processed in 579us (1444us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788651162.061517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 241 00000100:00100000:3.0:1788651162.088933:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651162.089038:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389446656 00000100:00100000:2.0:1788651162.089049:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389446656 00000100:00100000:2.0:1788651162.089151:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 295 00000100:00100000:2.0:1788651162.089163:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+7:2352:x1875536389446656:12345-192.168.203.21@tcp:251:umount.0 00000020:00000080:2.0:1788651162.089208:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879771cf 00000020:00010000:2.0:1788651162.089216:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93be45b1f000: total 0 00000100:00080000:2.0:1788651162.089221:0:5835:0:(import.c:65:import_set_state_nolock()) ffff93be45b1a800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788651162.089302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:674ed5c9-3ef5-41ff-ae15-73527c65e0c3+3:2352:x1875536389446656:12345-192.168.203.21@tcp:251:umount.0 Request processed in 141us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651162.089309:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 295 00000020:00010000:3.0:1788651162.089538:0:8436:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93be45b1f000: total 0 00010000:00010000:3.0:1788651162.089576:0:8436:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93be45b1f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788651162.089641:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9d200/0x84a2fba887977285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7bf83 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651162.089654:0:8436:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93be45b1f000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788651162.089664:0:8436:0:(genops.c:885:class_export_put()) final put ffff93be45b1f000/674ed5c9-3ef5-41ff-ae15-73527c65e0c3 00010000:00010000:3.0:1788651162.089682:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651162.089684:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651162.089698:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788651162.089737:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be45b1f000/674ed5c9-3ef5-41ff-ae15-73527c65e0c3 for MGS 00000020:00000080:1.0:1788651162.089776:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be45b1a800 for MGS 00000001:00100000:1.0:1788651162.558734:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:1.0:1788651162.558749:0:6698:0:(genops.c:885:class_export_put()) final put ffff93be74ff3000/f051ebe0-0677-425e-9b9b-54befcd9fd1c 00000020:00000080:2.0:1788651162.558823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be74ff3000/f051ebe0-0677-425e-9b9b-54befcd9fd1c for lustre-OST0000 00000020:00000080:2.0:1788651162.558875:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be74ff7800 for lustre-OST0000 00010000:00010000:1.0:1788651162.953997:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651163.524421:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408296704:0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.524478:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408296448:0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.524491:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.524522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.524556:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408296960:0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.524557:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651163.524568:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408296832:0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.524595:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651163.524616:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.524628:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788651163.524646:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408296576:0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.524657:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296704 00000100:00100000:1.0:1788651163.524666:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296704 00000100:00100000:0.0:1788651163.524675:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.524694:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408297088:0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.524717:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651163.524718:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296960 00000100:00100000:1.0:1788651163.524721:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296960 00000100:00100000:1.0:1788651163.524734:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296576 00000100:00100000:1.0:1788651163.524736:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296576 00000100:00100000:1.0:1788651163.524749:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788651163.524753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296448 00000100:00100000:1.0:1788651163.524756:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408296704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.524760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296448 00000100:00100000:0.0:1788651163.524798:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788651163.524806:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408296448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.524843:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3308:x1875536408296448:12345-0@lo:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.524849:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788651163.524880:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408296704:12345-0@lo:400:kworker.0 Request processed in 123us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.524887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788651163.524899:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788651163.524905:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408296960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.524918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788651163.524927:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408296576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.524941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408296960:12345-0@lo:400:kworker.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.524949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788651163.524965:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408296576:12345-0@lo:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.524977:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408296832 00000100:00100000:0.0:1788651163.524982:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408296832 00000100:00100000:0.0:1788651163.525008:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297088 00000100:00100000:0.0:1788651163.525011:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297088 00000100:00100000:0.0:1788651163.525030:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788651163.525036:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408296832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.525047:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788651163.525073:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408296832:12345-0@lo:400:kworker.0 Request processed in 37us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651163.525078:0:10263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788651163.525086:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788651163.525091:0:10263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.525149:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408296576:0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.525173:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408296448:0@lo:400:kworker.0 00000100:00100000:0.0:1788651163.525186:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408296960:0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.525204:0:10263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408297088:12345-0@lo:400:kworker.0 Request processed in 117us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651163.525220:0:10263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788651163.525223:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408297088:0@lo:400:kworker.0 00000100:00080000:1.0:1788651163.525244:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651163.525248:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651163.525251:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651163.525329:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408296832:0@lo:400:kworker.0 00000100:00100000:1.0:1788651163.525339:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408296704:0@lo:400:kworker.0 00000020:01000004:1.0:1788651163.878910:0:12998:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788651163.888315:0:12998:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788651163.888429:0:12998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.888444:0:12998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.888452:0:12998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.888459:0:12998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.888745:0:12998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788651163.888752:0:12998:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788651163.888776:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651163.888781:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788651163.888786:0:12998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788651163.888811:0:12998:0:(import.c:65:import_set_state_nolock()) ffff93be6cf92800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788651163.888875:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408297216:0@lo:39:umount.0 00000100:00100000:2.0:1788651163.888943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.889053:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297216 00000100:00100000:0.0:1788651163.889061:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297216 00000100:00100000:0.0:1788651163.889147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788651163.889166:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875536408297216:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788651163.889191:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976fec 00000100:00080000:0.0:1788651163.889199:0:5841:0:(import.c:65:import_set_state_nolock()) ffff93be42e4f000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788651163.889512:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651163.889561:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.889564:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.889573:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651163.889577:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651163.889607:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be42e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1875536408297216:12345-0@lo:39:umount.0 Request processed in 442us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.889615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788651163.889626:0:5841:0:(genops.c:885:class_export_put()) final put ffff93be42e49800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788651163.889636:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be6cf92800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788651163.889645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408297216:0@lo:39:umount.0 00000020:00000080:1.0:1788651163.889694:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be42e49800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788651163.889697:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651163.889704:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651163.889710:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651163.889713:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788651163.889715:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788651163.889740:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.889747:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788651163.889797:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408297344:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788651163.889816:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be42e4f000 for lustre-MDT0000 00000100:00100000:2.0:1788651163.889828:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788651163.889829:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651163.889833:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788651163.889836:0:12998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788651163.889882:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651163.889887:0:11151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297344 00010000:00010000:3.0:1788651163.889890:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821cd400/0x84a2fba887977254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797725b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651163.889891:0:11151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297344 00010000:00010000:3.0:1788651163.889901:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.889914:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.889916:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651163.889923:0:11151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788651163.889931:0:11151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45c18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3306:x1875536408297344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651163.889941:0:11151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651163.889958:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9d600/0x84a2fba88797725b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977254 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.889969:0:11151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651163.890461:0:11151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45c18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be0363c2-36c6-418a-b340-2685dfcc42ae+18:3306:x1875536408297344:12345-0@lo:103:ldlm_bl.0 Request processed in 530us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651163.890463:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408297344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651163.890469:0:11151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788651163.891522:0:12998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891534:0:12998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891539:0:12998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891543:0:12998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891561:0:12998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651163.891567:0:12998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891573:0:12998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891578:0:12998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891594:0:12998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891596:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651163.891612:0:12998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651163.891616:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891625:0:12998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891632:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821ccc00 already unused, calling callback (ffffffffc1d2ec20) 00010000:00010000:1.0:1788651163.891633:0:12998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651163.891636:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891640:0:12998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891645:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891646:0:12998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651163.891653:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651163.891658:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651163.891661:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788651163.891688:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891695:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651163.891717:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891717:0:12998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788651163.891724:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be821ccc00/0x84a2fba887977262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977269 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891724:0:12998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891731:0:12998:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891736:0:12998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891737:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651163.891741:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651163.891743:0:12998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891747:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40031a00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651163.891750:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891763:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651163.891769:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651163.891774:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651163.891777:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788651163.891779:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788651163.891785:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651163.891793:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.891794:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891799:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651163.891801:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56de00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:0.0:1788651163.891804:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.891811:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891814:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651163.891818:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891821:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be40031a00/0x84a2fba887977189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977190 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651163.891824:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788651163.891826:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788651163.891827:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788651163.891839:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651163.891841:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891842:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.891847:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651163.891848:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429ca400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651163.891851:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.891852:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891858:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.891860:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be6d56de00/0x84a2fba88797748b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977492 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.891869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651163.891870:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651163.891872:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788651163.891874:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651163.891879:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651163.891881:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:0.0:1788651163.891890:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408297600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651163.891891:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891896:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651163.891901:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.891908:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.891910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.891912:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651163.891921:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408297472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651163.891978:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651163.892027:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651163.892079:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651163.892086:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408297856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651163.892135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.892281:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651163.892305:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651163.892311:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408297728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651163.892338:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651163.892356:0:12998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788651163.892362:0:12998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429ca400/0x84a2fba887976f3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887976f44 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651163.892367:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297472 10000000:01000000:1.0:1788651163.892375:0:12998:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1788651163.892383:0:12998:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:0.0:1788651163.892385:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297472 10000000:01000000:1.0:1788651163.892387:0:12998:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788651163.892408:0:12998:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788651163.892412:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000100:00100000:0.0:1788651163.892414:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297856 00000020:00000080:1.0:1788651163.892416:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:0.0:1788651163.892416:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297856 00000020:00000080:1.0:1788651163.892421:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000100:00100000:0.0:1788651163.892425:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297600 00000020:00080000:1.0:1788651163.892427:0:12998:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93be75630800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1788651163.892427:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297600 00000020:00080000:1.0:1788651163.892433:0:12998:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93be488be000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1788651163.892436:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297728 00000100:00100000:0.0:1788651163.892438:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297728 00000020:00080000:1.0:1788651163.892440:0:12998:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff93be7ff88800 d7bda642-03c1-4a62-a15f-35e85e686a7f 192.168.203.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651163.892446:0:12998:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93be45693380) has exports, disconnecting them 00000020:00080000:1.0:1788651163.892449:0:12998:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93be75630800), last request at 1788651163 00000100:00100000:0.0:1788651163.892450:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000020:00000080:1.0:1788651163.892456:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887977151 00000100:00100000:0.0:1788651163.892457:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+21:3307:x1875536408297472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651163.892469:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1788651163.892470:0:12998:0:(import.c:65:import_set_state_nolock()) ffff93be75634000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788651163.892485:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40031600/0x84a2fba887977269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977262 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.892497:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1788651163.892507:0:12998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93be75630800): rc 0 00000020:00000080:1.0:1788651163.892509:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be75630800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788651163.892518:0:12998:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93be488be000), last request at 1788651163 00000020:00000080:1.0:1788651163.892521:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887977086 00000100:00080000:1.0:1788651163.892526:0:12998:0:(import.c:65:import_set_state_nolock()) ffff93be488b9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788651163.892528:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+20:3307:x1875536408297472:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.892534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:1.0:1788651163.892537:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be75630800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1788651163.892548:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651163.892554:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+19:3307:x1875536408297856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651163.892560:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1788651163.892568:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be75634000 for lustre-MDT0000 00010000:00010000:0.0:1788651163.892568:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd200/0x84a2fba887976f44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887976f3d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.892578:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1788651163.892579:0:12998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93be488be000): rc 0 00000020:00000080:1.0:1788651163.892592:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be488be000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788651163.892603:0:12998:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb91e00d1fae0 00000100:00100000:0.0:1788651163.892611:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+18:3307:x1875536408297856:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (475us total) trans 0 rc 0/0 00000020:00000080:1.0:1788651163.892614:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be488be000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1788651163.892622:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651163.892635:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651163.892641:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+17:3308:x1875536408297600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651163.892648:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651163.892656:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429ca000/0x84a2fba887977190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977189 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651163.892748:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.892753:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788651163.892798:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be488b9800 for lustre-MDT0000 00000100:00080000:1.0:1788651163.892821:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788651163.892824:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:0.0:1788651163.892845:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1788651163.892872:0:12998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788651163.892875:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+16:3308:x1875536408297600:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.892881:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651163.892893:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788651163.892899:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+15:3308:x1875536408297728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651163.892906:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651163.892914:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a200/0x84a2fba887977492 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba88797748b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651163.892923:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788651163.892937:0:12998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788651163.892941:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3308:x1875536408297728:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651163.892946:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788651163.892951:0:12998:0:(import.c:65:import_set_state_nolock()) ffff93be461f6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788651163.892964:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788651163.892967:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788651163.892974:0:12998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788651163.893029:0:12998:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788651163.893037:0:12998:0:(import.c:65:import_set_state_nolock()) ffff93be502ea800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788651163.893080:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93be45693380) has no exports 00000100:00100000:0.0:1788651163.893087:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408297728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651163.893101:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408297600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651163.893146:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408297856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651163.893153:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408297472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651163.893593:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651163.893605:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408297984:0@lo:9:umount.0 00000100:00100000:2.0:1788651163.893716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651163.893756:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408298112:0@lo:9:umount.0 00000100:00100000:2.0:1788651163.893778:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651163.893858:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408297984 00000100:00100000:1.0:1788651163.893858:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298112 00000100:00100000:3.0:1788651163.893864:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408297984 00000100:00100000:1.0:1788651163.893864:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298112 00000100:00100000:3.0:1788651163.893932:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788651163.893957:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875536408297984:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788651163.893979:0:6675:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879770d3 00000100:00080000:3.0:1788651163.893986:0:6675:0:(import.c:65:import_set_state_nolock()) ffff93bd412b9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788651163.894023:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788651163.894097:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788651163.894143:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788651163.894153:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875536408298112:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788651163.894176:0:6674:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879771ba 00000100:00080000:1.0:1788651163.894182:0:6674:0:(import.c:65:import_set_state_nolock()) ffff93be45b19000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651163.894204:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788651163.894215:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788651163.894611:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1875536408298112:12345-0@lo:9:umount.0 Request processed in 505us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651163.894619:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788651163.894655:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be502ea800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788651163.894666:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788651163.894668:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651163.894671:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408298112:0@lo:9:umount.0 00000100:00100000:3.0:1788651163.894688:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875536408297984:12345-0@lo:9:umount.0 Request processed in 749us (971us total) trans 0 rc 0/0 00000100:00080000:1.0:1788651163.894689:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be461f6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788651163.894694:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1788651163.894697:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788651163.894698:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651163.894700:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408297984:0@lo:9:umount.0 00010000:00010000:3.0:1788651163.894714:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651163.894719:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788651163.898631:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93be45693380) has no exports 00000020:00000080:2.0:1788651163.929445:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f98 00000020:00000080:2.0:1788651163.929460:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be752e0000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788651163.929479:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788651163.929577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be752e0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788651163.929596:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651163.929607:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788651163.929611:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93be76594d40) has no exports 00000020:00000080:3.0:1788651163.929824:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f91 00000020:00000080:3.0:1788651163.929831:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be7659d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788651163.929901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be7659d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788651163.929954:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651163.929959:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788651163.929962:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be758dc800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788651163.929963:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be758dc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788651163.929968:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788651163.972600:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651165.000971:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651166.020495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788651166.149929:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d7bda642-03c1-4a62-a15f-35e85e686a7f 00000001:00080000:0.0:1788651166.149945:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788651166.149951:0:5863:0:(genops.c:885:class_export_put()) final put ffff93be7ff88800/d7bda642-03c1-4a62-a15f-35e85e686a7f 00000020:00000080:0.0:1788651166.149972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be7ff88800/d7bda642-03c1-4a62-a15f-35e85e686a7f for lustre-MDT0000 00000020:00000080:0.0:1788651166.150031:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be7ff8b800 for lustre-MDT0000 00000001:00100000:0.0:1788651166.162798:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788651166.162805:0:7633:0:(genops.c:885:class_export_put()) final put ffff93be45b1d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788651166.162947:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be45b1d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788651166.163229:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be45b19000 for lustre-OST0001 00010000:00010000:2.0:1788651167.044581:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788651167.695585:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788651167.695594:0:6698:0:(genops.c:885:class_export_put()) final put ffff93bd412bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788651167.696590:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93bd412bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788651167.696653:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93bd412b9000 for lustre-OST0000 00010000:00010000:3.0:1788651168.070197:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651168.644446:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408298240:0@lo:400:kworker.0 00000100:00100000:3.0:1788651168.644520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651168.644644:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408298368:0@lo:400:kworker.0 00000100:00100000:1.0:1788651168.644689:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651168.644727:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651168.644734:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408298496:0@lo:400:kworker.0 00000100:00100000:1.0:1788651168.644755:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651168.644784:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298368 00000100:00100000:1.0:1788651168.644793:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298368 00000100:00100000:1.0:1788651168.644827:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298496 00000100:00100000:1.0:1788651168.644830:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298496 00000100:00100000:1.0:1788651168.644845:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788651168.644852:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875536408298368:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788651168.644859:0:5871:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788651168.644900:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875536408298368:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651168.644907:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788651168.644923:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788651168.644927:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875536408298496:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788651168.644931:0:5871:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788651168.644951:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1875536408298496:12345-0@lo:400:kworker.0 Request processed in 23us (195us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651168.644957:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788651168.644987:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788651168.644993:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788651168.644996:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788651168.645782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298240 00000100:00100000:0.0:1788651168.645790:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298240 00000100:00100000:0.0:1788651168.645842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788651168.645851:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3307:x1875536408298240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651168.645917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be50337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be0363c2-36c6-418a-b340-2685dfcc42ae+14:3307:x1875536408298240:12345-0@lo:400:kworker.0 Request processed in 68us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651168.645924:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788651168.646029:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be0363c2-36c6-418a-b340-2685dfcc42ae:3307:1875536408298240:0@lo:400:kworker.0 00000100:00080000:1.0:1788651168.660397:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788651168.660412:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 197 00000100:00080000:1.0:1788651168.660598:0:3308:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93be6d7b1000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788651168.660658:0:3308:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be74f95f80 x1875536408298624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788651168.660732:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408298624:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788651168.660813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651168.660916:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298624 00000100:00100000:3.0:1788651168.660926:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298624 00000100:00100000:3.0:1788651168.660978:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788651168.660988:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875536408298624:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788651168.661006:0:5871:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788651168.664448:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408298496:0@lo:400:kworker.0 00000100:00080000:1.0:1788651168.664491:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788651168.664497:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93bd412bf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788651168.664501:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788651168.664506:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93bd412bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788651168.664510:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 181 00000100:00080000:1.0:1788651168.664518:0:3308:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93bd412bf000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788651168.664565:0:3308:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be74f96d80 x1875536408298752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788651168.665068:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875536408298752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788651168.665131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651168.665209:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875536408298624:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4219us (4393us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788651168.665236:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788651168.665263:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298752 00000100:00100000:3.0:1788651168.665270:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298752 00000100:00100000:3.0:1788651168.665296:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788651168.665304:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875536408298752:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788651168.665319:0:5871:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788651168.665361:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875536408298752:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (230us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788651168.665367:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788651168.667909:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408298368:0@lo:400:kworker.0 00000100:00080000:2.0:1788651168.668150:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788651168.668157:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788651168.668161:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408298624:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788651168.668185:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93bd412bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788651168.668189:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788651168.668192:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875536408298752:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788651169.097165:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788651169.988273:0:12998:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be75658ae0 - data ffff93be69734798/ffff93be7563e800 00000020:01000000:3.0:1788651169.988412:0:12998:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be45aeb8a0 - data ffff93be57c65948/ffff93be46049800 00000001:00000004:3.0:1788651169.993734:0:12998:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788651170.078518:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788651170.078527:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788651170.078560:0:12998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788651170.078564:0:12998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788651170.078951:0:7164:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788651170.078956:0:7164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788651170.078964:0:7164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788651170.079958:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788651170.079971:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788651170.079992:0:12998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788651170.079994:0:12998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788651170.080710:0:8013:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788651170.080715:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788651170.080727:0:8013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:2.0:1788651170.120010:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788651170.136680:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f60 00000020:00000080:2.0:1788651170.136692:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be6cf6a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788651170.137148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6cf6a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788651170.137919:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f75 00000020:00000080:2.0:1788651170.137929:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be758dd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788651170.137946:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788651170.137952:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651170.137960:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788651170.137965:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93be456919c0) has no exports 00000020:00000080:0.0:1788651170.138132:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be758dd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788651170.138145:0:12998:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788651170.138155:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879771b3 00000020:00000080:2.0:1788651170.138159:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be45b1f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788651170.138173:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788651170.138176:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651170.138183:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788651170.138185:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93be7bba4d40) has no exports 00000020:00000080:2.0:1788651170.138191:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879771ac 00000020:00000080:2.0:1788651170.138194:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be502ea000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788651170.138225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be45b1f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788651170.138236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be502ea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788651170.138948:0:12998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788651170.138954:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788651170.138958:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788651170.138964:0:12998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788651170.138966:0:12998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788651170.139010:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651170.139018:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651170.139025:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879770cc 00000020:00000080:2.0:1788651170.139030:0:12998:0:(genops.c:885:class_export_put()) final put ffff93bd4121a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788651170.139034:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788651170.139038:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651170.139052:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788651170.139055:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93be58bf99c0) has no exports 00000020:00000080:2.0:1788651170.139062:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879770c5 00000020:00000080:2.0:1788651170.139065:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be461f2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788651170.139096:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be502ea800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788651170.139128:0:37:0:(genops.c:885:class_export_put()) final put ffff93be5b6a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788651170.139131:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be5b6a7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788651170.139138:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788651170.139224:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93bd4121a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788651170.139229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be461f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788651170.140289:0:12998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788651170.140295:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788651170.140298:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788651170.140303:0:12998:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788651170.140306:0:12998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788651170.140355:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651170.140355:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be461f6000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788651170.140364:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651170.140369:0:12998:0:(genops.c:885:class_export_put()) final put ffff93bd41219800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788651170.140373:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93bd41219800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788651170.140378:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651170.140508:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651170.140513:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651170.140516:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be6cf68000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788651170.140518:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6cf68000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788651170.140525:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651170.140629:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f7c 00000020:00000080:2.0:1788651170.140636:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be758df800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788651170.140649:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788651170.140654:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651170.140658:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788651170.140661:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93be45694d40) has no exports 00000020:00000080:0.0:1788651170.140673:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be758df800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788651170.140681:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651170.140686:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788651170.140688:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be6cf69800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788651170.140691:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6cf69800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788651170.140697:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788651170.141935:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f83 00000020:00000080:2.0:1788651170.141955:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be758db000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788651170.141985:0:12998:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93be4384a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788651170.141988:0:12998:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be4384a800 3 00000020:01000004:2.0:1788651170.141991:0:12998:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93be4384a800 from lustre-MDT0000 00000020:00000080:2.0:1788651170.142026:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651170.142034:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788651170.142045:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be6cf6f000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788651170.142048:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6cf6f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788651170.142056:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788651170.142090:0:12998:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788651170.142094:0:12998:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788651170.142097:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788651170.142101:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651170.142120:0:12998:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788651170.142127:0:12998:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93be456b2800 be0363c2-36c6-418a-b340-2685dfcc42ae 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788651170.142133:0:12998:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93be45c63380) has exports, disconnecting them 00000020:00080000:2.0:1788651170.142138:0:12998:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93be456b2800), last request at 1788650958 00000020:00000080:2.0:1788651170.142153:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f21 00000020:00010000:2.0:1788651170.142157:0:12998:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93be456b2800: total 1 00000100:00080000:2.0:1788651170.142162:0:12998:0:(import.c:65:import_set_state_nolock()) ffff93be456b6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788651170.142184:0:12998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93be456b2800): rc 0 00000020:00080000:2.0:1788651170.142188:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93be45c63380) has no exports 00000100:00100000:2.0:1788651170.142239:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93be4411e200:5834] 1 exiting: rc = 0 00000020:00010000:1.0:1788651170.142240:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93be456b2800: total 1 00010000:00010000:1.0:1788651170.142272:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93be456b2800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788651170.142300:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cc400/0x84a2fba88797724d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977246 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142317:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618b000/0x84a2fba887977484 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba88797747d expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142326:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cda00/0x84a2fba887977039 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977032 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142351:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be429cae00/0x84a2fba887977277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977270 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651170.142359:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93be45aec600:5833] 0 exiting: rc = 1 00010000:00010000:1.0:1788651170.142361:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a800/0x84a2fba887977476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba88797746f expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142373:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd800/0x84a2fba887977223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba88797721c expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142383:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be40031000/0x84a2fba88797723f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba887977238 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142393:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be821cd600/0x84a2fba887977231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84a2fba88797722a expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651170.142403:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93be456b2800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788651170.142416:0:5830:0:(genops.c:885:class_export_put()) final put ffff93be456b2800/be0363c2-36c6-418a-b340-2685dfcc42ae 00010000:00010000:1.0:1788651170.142422:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651170.142425:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651170.142427:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651170.142470:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93be45aeca00:5835] 2 exiting: rc = 0 00000020:00000080:0.0:1788651170.142526:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be758db000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788651170.142532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be456b2800/be0363c2-36c6-418a-b340-2685dfcc42ae for MGS 00000020:00000080:0.0:1788651170.142579:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be456b6000 for MGS 00000100:00100000:2.0:1788651170.142682:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142691:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142697:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142703:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142709:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142715:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142720:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142726:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142741:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142752:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142758:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142764:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142770:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142776:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142782:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142787:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142793:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142798:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142804:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142811:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142816:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142820:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142826:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142833:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142840:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142847:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142855:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142863:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142869:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142876:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142883:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142890:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142899:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142907:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142916:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142924:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142931:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142938:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142946:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142953:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142960:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142966:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142971:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142985:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142990:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.142996:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143001:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143006:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143012:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143017:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143022:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143027:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143031:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143037:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143041:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143046:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143051:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143055:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143061:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143066:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143070:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143075:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143080:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.143085:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788651170.143672:0:12998:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788651170.143676:0:12998:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788651170.146391:0:12998:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be658f4300 - data ffff93be6ffa76c0/ffff93be7be0e000 00000020:01000000:2.0:1788651170.146687:0:12998:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be5968c9c0 - data ffff93be697bc5e8/ffff93be45ae2800 00000020:00000080:2.0:1788651170.147672:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f05 00000020:00000080:2.0:1788651170.147681:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be588ab000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788651170.147704:0:12998:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93be4384a800 from MGS, refs=2 00000020:01000004:2.0:1788651170.147707:0:12998:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be4384a800 2 00000020:01000004:2.0:1788651170.147710:0:12998:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93be4384a800 from MGS 00000020:00000080:2.0:1788651170.147736:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651170.147743:0:12998:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788651170.147746:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be46385000/MGS 00000020:00000080:2.0:1788651170.147748:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be46385000/MGS for MGS 00000020:01000000:2.0:1788651170.147756:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788651170.147823:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788651170.147827:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651170.147834:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1788651170.147834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be588ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1788651170.147842:0:12998:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93be6cf96000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788651170.147849:0:12998:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93be58bf8000) has exports, disconnecting them 00000020:00080000:2.0:1788651170.147855:0:12998:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93be6cf96000), last request at 1788650959 00000020:00000080:2.0:1788651170.147859:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976fd0 00000020:00080000:2.0:1788651170.147870:0:12998:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93be6cf96000): rc 0 00000020:00000080:2.0:1788651170.147874:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be6cf96000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788651170.147913:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6cf96000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788651170.156208:0:12998:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788651170.156217:0:12998:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651170.156222:0:12998:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788651170.156230:0:12998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788651170.156282:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be6cf92800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788651170.156402:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651170.156410:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788651170.156415:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be6cf90800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788651170.156419:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6cf90800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788651170.156445:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788651170.156507:0:12998:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be4384a800 1 00000020:00000080:0.0:1788651170.156512:0:12998:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976ef7 00000020:00000080:0.0:1788651170.156527:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be46380800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788651170.156547:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788651170.156553:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651170.156557:0:12998:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788651170.156561:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93be45c619c0) has no exports 00000020:00000080:1.0:1788651170.156567:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be46380800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788651170.240390:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651170.240404:0:12998:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788651170.240410:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be588ad000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788651170.240415:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be588ad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788651170.240424:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788651170.240907:0:12998:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93be588a8800 00000020:01000000:1.0:1788651170.240929:0:12998:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788651170.240933:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651170.240938:0:12998:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788651170.240942:0:12998:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93be456d4d40) has no exports 00000100:00100000:3.0:1788651170.241026:0:5871:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93be4419ec00:5871] 3 exiting: rc = 0 00000100:00100000:0.0:1788651170.241160:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93be4411e400:5843] 2 exiting: rc = 0 00000100:00100000:0.0:1788651170.241533:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93be45c97200:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1788651170.241647:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93be45c96e00:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1788651170.241696:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241705:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241712:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241720:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241732:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241744:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241751:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.241762:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243687:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243701:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243710:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243733:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243742:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243749:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243757:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243764:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243772:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243779:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243785:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243792:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243800:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243807:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243816:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243824:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243830:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243837:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243845:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243856:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243867:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243879:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243902:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243908:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243923:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243935:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243944:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243956:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243966:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243978:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243986:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.243994:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244002:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244013:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244021:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244030:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244036:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244043:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244049:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244054:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244059:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244064:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244070:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244075:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244080:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244085:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244091:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244096:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244101:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244121:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244128:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244134:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244140:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244149:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244155:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.244165:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.253747:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93be48fb1000:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1788651170.253769:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93be48fb1a00:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1788651170.253948:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253956:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253963:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253970:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253975:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253980:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253986:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253992:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.253999:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254004:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254010:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254016:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254024:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254041:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254055:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254061:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254067:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254071:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254077:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254082:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254088:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254093:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254098:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254103:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254127:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254132:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254137:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254143:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254150:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254158:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254165:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254170:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254176:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254181:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254186:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254210:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254216:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254222:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254228:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254233:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254237:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254242:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254247:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254253:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254257:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254262:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254267:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254272:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254277:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254282:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254287:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254291:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254296:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254301:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254307:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254313:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254318:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254324:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254453:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254459:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254465:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254471:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254476:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.254481:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.254982:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93be5900dc00:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788651170.255707:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93be59000c00:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1788651170.256613:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256626:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256634:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256643:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256651:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256658:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256679:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256687:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256695:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256703:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256711:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256720:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256730:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256738:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256747:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256776:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256786:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256796:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256803:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256811:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256819:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256830:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256841:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256852:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256862:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256878:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256886:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256907:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256950:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256958:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256965:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256974:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256982:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256989:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.256997:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257016:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257025:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257032:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257040:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257063:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257070:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257082:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257088:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257094:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257100:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257211:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257222:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257229:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257234:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257240:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257245:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257265:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257271:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257277:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257283:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257288:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257294:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257300:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257306:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257313:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257322:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257329:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257334:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.257348:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.281720:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93be48f89e00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788651170.281862:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93be48f88200:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1788651170.282303:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282311:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282316:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282321:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282326:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282331:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282336:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282341:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282346:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282351:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282357:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282362:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282367:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282373:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282378:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282383:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282387:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282392:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282396:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282401:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282405:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282410:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282415:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282420:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282425:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282430:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282435:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282440:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282445:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282449:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282454:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282459:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282464:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282480:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282485:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282491:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282496:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282500:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282505:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282510:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282515:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282520:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282525:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282530:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282535:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282549:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282554:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282558:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282563:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282567:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282572:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282576:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282581:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282586:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282591:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282595:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282600:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282605:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282609:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282613:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282617:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282621:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282625:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.282630:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.282981:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93be48f89800:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1788651170.283068:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93be48f87600:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1788651170.283216:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283222:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283228:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283234:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283247:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283252:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283257:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283263:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283267:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283273:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283278:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283284:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283289:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283295:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283300:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283306:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283311:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283316:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283321:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283326:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283331:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283336:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283341:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283346:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283350:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283355:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283359:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283365:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283369:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283374:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283380:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283385:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283390:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283395:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283401:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283407:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283412:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283417:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283423:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283435:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283440:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283446:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283451:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283457:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283462:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283468:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283474:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283480:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283486:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283491:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283496:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283502:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283507:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283512:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283518:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283523:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283529:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283535:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283552:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283558:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283564:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283569:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283574:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.283580:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651170.284478:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93be48f89400:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1788651170.284936:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93be48f88000:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1788651170.285146:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285154:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285159:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285164:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285170:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285175:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285180:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285185:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285191:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285196:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285212:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285217:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285223:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285228:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285234:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285239:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285245:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285250:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285256:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285261:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285267:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285272:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285277:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285282:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285288:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285293:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285299:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285304:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285309:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285314:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285320:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285324:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285329:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285335:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285340:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285345:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285350:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285355:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285361:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285366:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285371:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285376:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285381:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285386:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285391:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285403:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285408:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285413:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285418:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285423:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285428:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285434:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285439:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285444:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285449:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285455:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285461:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285466:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285471:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285476:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285481:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285486:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285491:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285497:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651170.285951:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93be44d74600:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1788651170.286402:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93be48f86600:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1788651170.286636:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93be48fb1200:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1788651170.286819:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286826:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286831:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286837:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286842:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286847:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286853:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286858:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286864:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286869:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286874:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286891:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286896:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286902:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286908:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286913:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286918:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286924:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286930:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286935:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286941:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.286947:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287025:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287034:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287041:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287046:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287052:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287058:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287063:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287070:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287076:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287082:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287088:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287094:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287101:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287273:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287282:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287288:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287295:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287301:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287307:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287313:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287319:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287324:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287332:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287338:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287364:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287371:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287378:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287384:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287390:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287395:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287400:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287406:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287412:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287417:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287423:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287429:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287435:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287441:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287448:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287453:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287459:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651170.287466:0:12998:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788651170.291950:0:12998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651170.292446:0:12998:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788651170.292452:0:12998:0:(genops.c:885:class_export_put()) final put ffff93be44516800/MDS_uuid 00000020:00000080:1.0:1788651170.292457:0:12998:0:(genops.c:844:class_export_destroy()) destroying export ffff93be44516800/MDS_uuid for MDS 00000020:01000000:1.0:1788651170.292462:0:12998:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788651170.292750:0:12998:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788651171.142935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651172.164789:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788651172.913464:0:13154:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788651172.932426:0:13154:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788651172.932476:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.932492:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.932500:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.932507:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.932576:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788651172.932582:0:13154:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788651172.932618:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651172.932624:0:13154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788651172.932630:0:13154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788651172.932637:0:13154:0:(import.c:65:import_set_state_nolock()) ffff93bd412bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788651172.932643:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651172.932645:0:13154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788651172.932648:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788651172.933633:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.933646:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.933652:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.933657:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651172.933969:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651172.933977:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651172.933984:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9d800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651172.933988:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651172.934023:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651172.934031:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651172.934037:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788651172.934039:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788651172.934042:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788651172.934311:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651172.934321:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.934329:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.934334:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.934340:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651172.934359:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788651172.934363:0:13154:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788651172.934382:0:13154:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788651172.934386:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788651172.934391:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651172.934396:0:13154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788651172.934400:0:13154:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93be456d0000) has no exports 00000020:00080000:0.0:1788651172.934428:0:13154:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93be456d0000) has no exports 00010000:00010000:3.0:1788651172.935138:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651172.935157:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.935296:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651172.937132:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651172.937156:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651172.937194:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651172.937202:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba887977238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797723f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651172.937224:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651172.937227:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651172.937230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651172.937331:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408298880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651172.937401:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651172.937484:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408298880 00000100:00100000:1.0:1788651172.937493:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408298880 00000100:00100000:1.0:1788651172.937554:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788651172.937562:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875536408298880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788651172.937568:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651172 with bad export cookie 9557478060481539873 00010000:00010000:3.0:1788651172.939505:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9d400 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651172.939515:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651172.939539:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651172.939567:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651172.939572:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651172.939575:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788651172.939578:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000000:0.0:1788651172.939712:0:13154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be46b1ea20 - data ffff93be57c47d80/ffff93be7b9dcc00 00000020:01000000:0.0:1788651172.939853:0:13154:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be441807e0 - data ffff93be6975c288/ffff93bd412b2800 00010000:00010000:2.0:1788651172.941482:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941494:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651172.941519:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941539:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d400/0x84a2fba887977246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba88797724d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941553:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651172.941555:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651172.941558:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651172.941715:0:13155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651172.941719:0:13155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651172.941720:0:13155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651172.941749:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941756:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9da00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1788651172.941760:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941769:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651172.941775:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651172.941780:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788651172.941783:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788651172.941786:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788651172.941805:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941810:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788651172.941857:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408299136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651172.941920:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788651172.941980:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941988:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9da00/0x84a2fba88797747d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84a2fba887977484 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651172.941997:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651172.941999:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651172.942001:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651172.942025:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408299136 00000100:00100000:2.0:1788651172.942032:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408299136 00000100:00100000:2.0:1788651172.942068:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651172.942093:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875536408299136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788651172.942100:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651172 with bad export cookie 9557478060481539873 00000100:00100000:2.0:1788651172.942576:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875536408299136:12345-0@lo:103:ldlm_bl.0 Request processed in 490us (653us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788651172.942585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788651172.942670:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788651172.942675:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93be46385800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788651172.942678:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788651172.953352:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788651172.954986:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.121@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788651172.954990:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788651172.955001:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93be74f95180 x1875536408298880/t0(0) o103->MGC192.168.203.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651188 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651172.955015:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93be7556bb80 x1875536408299136/t0(0) o103->MGC192.168.203.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651188 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788651172.955029:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788651172.955032:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788651172.955033:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788651172.958657:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:0:1875536408299008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651172.958683:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be0363c2-36c6-418a-b340-2685dfcc42ae:3306:1875536408298880:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788651172.965871:0:5826:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875536408298880 offset 224 length 224: 4 00000100:00100000:0.0:1788651172.965897:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875536408298880:12345-0@lo:103:ldlm_bl.0 Request processed in 28332us (28493us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788651172.965910:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788651172.965912:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93be46385800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788651172.965920:0:3308:0:(import.c:545:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 162 00000100:00080000:3.0:1788651172.965929:0:3308:0:(import.c:665:import_select_connection()) MGC192.168.203.121@tcp: import ffff93be46385800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1788651172.966011:0:3308:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be75568000 x1875536408299264/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788651172.966059:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be0363c2-36c6-418a-b340-2685dfcc42ae:3308:1875536408299136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651172.966141:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be0363c2-36c6-418a-b340-2685dfcc42ae:3305:1875536408299264:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788651172.966199:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875536408299264 offset 0 length 520: 4 00100000:10000000:2.0:1788651172.986014:0:13154:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788651173.014730:0:13154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887977055 00000020:00000080:1.0:1788651173.014740:0:13154:0:(genops.c:885:class_export_put()) final put ffff93be488bd800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788651173.014764:0:13154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93be7bfe0800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788651173.014769:0:13154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be7bfe0800 2 00000020:01000004:1.0:1788651173.014773:0:13154:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93be7bfe0800 from lustre-OST0000 00000020:00000080:1.0:1788651173.014804:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651173.014813:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788651173.014816:0:13154:0:(genops.c:885:class_export_put()) final put ffff93be502ec000/lustre-OST0000_UUID 00000020:00000080:1.0:1788651173.014818:0:13154:0:(genops.c:844:class_export_destroy()) destroying export ffff93be502ec000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788651173.014825:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788651173.014864:0:13154:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788651173.014868:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788651173.014872:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651173.014876:0:13154:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788651173.014882:0:13154:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93bd412bb800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651173.014888:0:13154:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff93be76590000) has exports, disconnecting them 00000020:00080000:1.0:1788651173.014892:0:13154:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93bd412bb800), last request at 1788650977 00000020:00000080:1.0:1788651173.014896:0:13154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba88797707f 00000020:00080000:1.0:1788651173.014905:0:13154:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93bd412bb800): rc 0 00000020:00000080:1.0:1788651173.014910:0:13154:0:(genops.c:885:class_export_put()) final put ffff93bd412bb800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788651173.015033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be488bd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788651173.015047:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93bd412bb800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788651173.015794:0:13154:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788651173.015799:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788651173.015803:0:13154:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788651173.015810:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788651173.015841:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93bd412bf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788651173.015977:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651173.015984:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788651173.015988:0:13154:0:(genops.c:885:class_export_put()) final put ffff93be461f4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788651173.015992:0:13154:0:(genops.c:844:class_export_destroy()) destroying export ffff93be461f4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788651173.016000:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788651173.016049:0:13154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be7bfe0800 1 00000020:00000080:2.0:1788651173.016054:0:13154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba88797700f 00000020:00000080:2.0:1788651173.016059:0:13154:0:(genops.c:885:class_export_put()) final put ffff93be7bfe7000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788651173.016075:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788651173.016079:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651173.016083:0:13154:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788651173.016086:0:13154:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93be45c64d40) has no exports 00000020:00000080:3.0:1788651173.016128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93be7bfe7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788651173.048827:0:13154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651173.048843:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788651173.048849:0:13154:0:(genops.c:885:class_export_put()) final put ffff93be7bfe6800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788651173.048854:0:13154:0:(genops.c:844:class_export_destroy()) destroying export ffff93be7bfe6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788651173.048863:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788651173.049011:0:13154:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93be7bfe1800 00000020:02000400:3.0:1788651173.049076:0:13154:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788651173.193041:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788651173.765560:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651173.765570:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788651173.765575:0:36:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651173.765583:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 372 00000100:00080000:0.0:1788651173.765590:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788651173.765597:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93be6d7b1000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1788651173.765639:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be75407800 x1875536408299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651173.765739:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408299392:0@lo:38:kworker.0 00000400:00000100:1.0:1788651173.765793:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875536408299392 offset 0 length 520: 4 00010000:00010000:2.0:1788651174.217588:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651175.236316:0:13155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788651175.956361:0:13305:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788651175.969275:0:13305:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788651175.969359:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.969374:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.969381:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.969388:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.969419:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788651175.969424:0:13305:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788651175.969443:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651175.969454:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93be75407800 x1875536408299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651175.969469:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788651175.969475:0:13305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788651175.969481:0:13305:0:(import.c:65:import_set_state_nolock()) ffff93be6d7b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788651175.969486:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651175.969489:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93be75407800 x1875536408299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651188 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651175.969495:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788651175.969498:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:3.0:1788651175.969571:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651175.969579:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651175.969586:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cac00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651175.969590:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651175.969599:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651175.969606:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651175.969612:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651175.969617:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788651175.969620:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788651175.969647:0:8436:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93be46385800 00010000:00010000:3.0:1788651175.969652:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651175.969659:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429cac00/0x84a2fba88797721c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977223 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651175.969709:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651175.969718:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651175.969720:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651175.970004:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408299392:0@lo:38:kworker.0 00010000:00010000:0.0:1788651175.977566:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977598:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977606:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977613:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977635:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651175.977641:0:13305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977647:0:13305:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977654:0:13305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977660:0:13305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651175.977672:0:13305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788651175.977676:0:13305:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1788651175.977690:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651175.977700:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788651175.977700:0:13305:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788651175.977705:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788651175.977711:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788651175.977712:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be40030e00 already unused, calling callback (ffffffffc1d2ec20) 00000020:00000080:0.0:1788651175.977717:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788651175.977721:0:13305:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93be58bfb380) has no exports 10000000:00010000:1.0:1788651175.977725:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651175.977737:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651175.977744:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651175.977750:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788651175.977752:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:00080000:0.0:1788651175.977752:0:13305:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93be58bfb380) has no exports 10000000:01000000:1.0:1788651175.977757:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788651175.977772:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93be46385800 00010000:00010000:1.0:1788651175.977776:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651175.977784:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be40030e00/0x84a2fba88797722a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651175.977797:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651175.977801:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651175.977807:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9dc00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651175.977810:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651175.977816:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651175.977821:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651175.977832:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788651175.977834:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788651175.977836:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788651175.977842:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93be46385800 00010000:00010000:1.0:1788651175.977845:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651175.977851:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651175.977852:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797746f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651175.977866:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651175.977868:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651175.977869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788651175.979374:0:13305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be46b1e420 - data ffff93be69764ca8/ffff93be74fc1000 00000020:01000000:0.0:1788651175.980853:0:13305:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93be42eb9ba0 - data ffff93be697171b0/ffff93be7584c000 00100000:10000000:0.0:1788651175.995700:0:13305:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788651176.018754:0:13305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887977120 00000020:00000080:3.0:1788651176.018765:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be502e9000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788651176.018788:0:13305:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93bd412bd800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788651176.018792:0:13305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93bd412bd800 2 00000020:01000004:3.0:1788651176.018795:0:13305:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93bd412bd800 from lustre-OST0001 00000020:00000080:3.0:1788651176.018818:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651176.018827:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788651176.018827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be502e9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788651176.018830:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be45abf000/lustre-OST0001_UUID 00000020:00000080:3.0:1788651176.018832:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff93be45abf000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788651176.018839:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788651176.019217:0:13305:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import be0363c2-36c6-418a-b340-2685dfcc42ae->MGS 00010000:00010000:3.0:1788651176.019233:0:13305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651176.019314:0:13305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651176.019322:0:13305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788651176.019324:0:13305:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788651176.019327:0:13305:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788651176.019342:0:13305:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93be46385800 00010000:00010000:3.0:1788651176.019346:0:13305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba887977032 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977039 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651176.019363:0:13305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651176.019382:0:13305:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651176.019387:0:13305:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651176.019389:0:13305:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788651176.019391:0:13305:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788651176.019400:0:13305:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93be46385800 00010000:00010000:3.0:1788651176.019403:0:13305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be4618bc00/0x84a2fba887977270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84a2fba887977277 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651176.019420:0:13305:0:(import.c:65:import_set_state_nolock()) ffff93be46385800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788651176.019423:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788651176.019426:0:13305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788651176.019427:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788651176.019432:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788651176.019445:0:13305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93be75568000 x1875536408299264/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788651182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788651176.019528:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788651176.019532:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1788651176.019665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be0363c2-36c6-418a-b340-2685dfcc42ae:3305:1875536408299264:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1788651176.019725:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788651176.019733:0:13305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba887976f13 00000020:00000080:3.0:1788651176.019737:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be44514000/be0363c2-36c6-418a-b340-2685dfcc42ae 00000020:01000000:3.0:1788651176.019753:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.121@tcp (flags='') 00000020:00000080:3.0:1788651176.019759:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651176.019764:0:13305:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.121@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788651176.019768:0:13305:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93be45690000) has no exports 00000020:00000080:0.0:1788651176.019769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be44514000/be0363c2-36c6-418a-b340-2685dfcc42ae for MGC192.168.203.121@tcp 10000000:01000000:3.0:1788651176.019785:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788651176.019832:0:13305:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.121@tcp: client import never connected 00000100:00080000:3.0:1788651176.019834:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788651176.019837:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788651176.019846:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788651176.019848:0:13305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788651176.019886:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651176.019891:0:13305:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.121@tcp (uuid be0363c2-36c6-418a-b340-2685dfcc42ae) 00000020:01000000:3.0:1788651176.019897:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788651176.019900:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651176.019904:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788651176.019909:0:13305:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93be6d7b6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788651176.019914:0:13305:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff93be58bfcd40) has exports, disconnecting them 00000020:00080000:3.0:1788651176.019918:0:13305:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93be6d7b6800), last request at 1788650993 00000020:00000080:3.0:1788651176.019922:0:13305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba88797714a 00000020:00080000:3.0:1788651176.019933:0:13305:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93be6d7b6800): rc 0 00000020:00000080:3.0:1788651176.019936:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be6d7b6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788651176.022576:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be6d7b6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788651176.022931:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be46385800 for MGC192.168.203.121@tcp 00000020:00000080:0.0:1788651176.022941:0:37:0:(genops.c:885:class_export_put()) final put ffff93be42fac000/be0363c2-36c6-418a-b340-2685dfcc42ae 00000020:00000080:0.0:1788651176.022954:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be42fac000/be0363c2-36c6-418a-b340-2685dfcc42ae for MGC192.168.203.121@tcp 00000020:01000000:0.0:1788651176.022960:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.121@tcp (be0363c2-36c6-418a-b340-2685dfcc42ae) 00010000:01000000:0.0:1788651176.031807:0:13305:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788651176.031816:0:13305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651176.031820:0:13305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788651176.031827:0:13305:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788651176.031916:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93be6d7b1000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788651176.060175:0:13155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788651176.060411:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788651176.060574:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788651176.060761:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788651176.060889:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93be42f89600:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1788651176.060957:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93be59539800:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1788651176.061042:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788651176.061704:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93be45c75800:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1788651176.061792:0:11151:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93be6d7ada00:11151] 3 exiting: rc = 0 00000100:00100000:0.0:1788651176.061856:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93be45c75e00:5828] 2 exiting: rc = 0 00000100:00100000:0.0:1788651176.061900:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93be45c24800:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1788651176.061974:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.061982:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.061987:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.061993:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.061999:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062005:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062011:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062016:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062021:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062028:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062033:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062039:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062044:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062050:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062070:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062077:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062084:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062089:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062094:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062099:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062104:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062139:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062144:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062149:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062154:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062159:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062164:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062170:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062175:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062181:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062186:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062191:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062196:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062201:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062206:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062212:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062217:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062222:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062228:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062233:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062238:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062243:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062248:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062253:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062258:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062263:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062269:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062274:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062280:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062295:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062299:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062304:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062309:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062314:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062319:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062324:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062329:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062333:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062338:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062343:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062348:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062352:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062357:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.062362:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788651176.063188:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651176.063198:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788651176.063204:0:13305:0:(genops.c:885:class_export_put()) final put ffff93bd4121d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788651176.063209:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff93bd4121d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788651176.063220:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788651176.063264:0:13305:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93bd412bd800 1 00000020:00000080:1.0:1788651176.063271:0:13305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x84a2fba8879770ef 00000020:00000080:1.0:1788651176.063277:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be5b6a2800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788651176.063292:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788651176.063297:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651176.063301:0:13305:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788651176.063305:0:13305:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93be765919c0) has no exports 00000020:00000080:0.0:1788651176.063379:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93be5b6a2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788651176.072817:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651176.072832:0:13305:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788651176.072837:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be7659d000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788651176.072841:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff93be7659d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788651176.072848:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788651176.073756:0:13305:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93bd412bf800 00000020:01000000:1.0:1788651176.073787:0:13305:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788651176.073791:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651176.073795:0:13305:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788651176.073800:0:13305:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93be45c60000) has no exports 00000020:00000080:1.0:1788651176.073825:0:13305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651176.073831:0:13305:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788651176.073835:0:13305:0:(genops.c:885:class_export_put()) final put ffff93be7bfe2000/OSS_uuid 00000020:00000080:1.0:1788651176.073837:0:13305:0:(genops.c:844:class_export_destroy()) destroying export ffff93be7bfe2000/OSS_uuid for OSS 00000020:01000000:1.0:1788651176.073842:0:13305:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788651176.073945:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93be6d638000:6674] 1 exiting: rc = 0 00000100:00100000:2.0:1788651176.074866:0:12999:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff93bd43380e00:12999] 4 exiting: rc = 0 00000100:00080000:0.0:1788651176.074997:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788651176.075091:0:10263:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93be538ef600:10263] 3 exiting: rc = 0 00000100:00100000:0.0:1788651176.077436:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93be6161f800:6672] 0 exiting: rc = 1 00000100:00100000:0.0:1788651176.077542:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93be6d638a00:6675] 2 exiting: rc = 0 00000100:00100000:1.0:1788651176.077650:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077659:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077665:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077671:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077676:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077681:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077686:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077691:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077696:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077701:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077706:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077710:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077716:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077722:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077727:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077732:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077737:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077742:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077747:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077751:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077756:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077761:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077765:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077770:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077775:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077790:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077796:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077801:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077806:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077813:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077818:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077823:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077830:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077835:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077840:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077845:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077850:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077856:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077861:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077866:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077870:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077875:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077879:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077884:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077889:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077893:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077898:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077902:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077907:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077915:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077920:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077925:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077930:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077935:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077939:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077944:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077949:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077953:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077958:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077962:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077972:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077977:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077981:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.077987:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.078982:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93be488f1a00:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1788651176.079174:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93be439ff600:6677] 1 exiting: rc = 0 00000100:00100000:1.0:1788651176.080250:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080261:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080268:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080274:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080281:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080829:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080834:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080840:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080844:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080849:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080854:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080859:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080865:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080870:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080875:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080880:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080885:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080890:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080896:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080902:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080907:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080912:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080917:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080921:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080926:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080930:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080935:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080940:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080945:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080950:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080954:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080971:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080975:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080980:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.080984:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081003:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081406:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081417:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081423:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081427:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081432:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081437:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081443:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081448:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081453:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081458:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081463:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081468:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081473:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081479:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081484:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081492:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081498:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081514:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081519:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081524:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081530:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081535:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081541:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081546:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081550:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081555:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081560:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.081565:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.084603:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93be42e33600:6679] 1 exiting: rc = 0 00000100:00100000:3.0:1788651176.084998:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93be488f0e00:6680] 2 exiting: rc = 0 00000100:00100000:3.0:1788651176.085273:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93be488f1800:6678] 0 exiting: rc = 1 00000100:00100000:1.0:1788651176.085481:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085489:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085519:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085525:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085530:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085535:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085540:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085547:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085552:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085557:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085562:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085567:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085573:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085578:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085584:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085673:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085682:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085687:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085693:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085698:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085703:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085708:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085713:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085719:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085724:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085729:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085735:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085740:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085746:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085751:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085757:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085778:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085785:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085791:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085796:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085802:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085807:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085819:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085824:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085830:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085835:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085841:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085846:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085852:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085858:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085863:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085869:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085875:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085881:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085887:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085894:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085900:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085907:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085914:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085922:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085929:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085934:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085939:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085945:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085950:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085963:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085970:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085975:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.085981:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788651176.098237:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93be488f1600:6681] 0 exiting: rc = 1 00000100:00100000:0.0:1788651176.098332:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93be488f0800:6682] 1 exiting: rc = 0 00000100:00100000:1.0:1788651176.099246:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099253:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099258:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099263:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099267:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099272:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099277:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099424:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099440:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099445:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099450:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099456:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099460:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099465:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099470:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099474:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099479:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099483:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099488:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099492:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099497:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099515:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099520:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099526:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099532:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099536:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099541:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099546:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099550:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099555:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099561:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099565:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099570:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099575:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099591:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099598:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099604:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099609:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099615:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099621:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099626:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099631:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099635:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099648:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099654:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099659:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099664:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099668:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099673:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099679:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099684:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099689:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099694:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099701:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099706:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099714:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099720:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099724:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099729:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099734:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099739:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099745:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099750:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651176.099755:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651176.101471:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93be6d51d200:6683] 0 exiting: rc = 1 00000100:00100000:1.0:1788651176.102045:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93be6d51dc00:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1788651176.102213:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102222:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102231:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102238:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102245:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102258:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102264:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102270:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102277:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102283:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102368:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102375:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102385:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102391:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102398:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102403:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102410:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102453:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102460:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102465:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102470:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102477:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102482:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102487:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102492:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102507:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102514:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102521:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102527:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102549:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102558:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102565:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102572:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102578:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102695:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102711:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102717:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102724:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102731:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102736:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102744:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102767:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102775:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102780:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102795:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102802:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102808:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102814:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102819:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102958:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102969:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102975:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.102980:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103013:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103021:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103028:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103033:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103039:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103045:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103051:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103056:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103062:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103068:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651176.103090:0:13305:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788651176.111422:0:13305:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788651191.464906:0:13919:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788651199.073746:0:14383:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788651199.073751:0:14383:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788651199.073858:0:14383:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93be7c1e4800 00000020:01000004:0.0:1788651199.073872:0:14383:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788651199.073880:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788651199.073893:0:14383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93be456d19c0) 00000020:00000080:0.0:1788651199.073915:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788651199.090414:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788651199.092929:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788651199.093447:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 397: rc = 0 00100000:10000000:0.0:1788651199.093610:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1788651199.093709:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 397: rc = 0 00100000:10000000:0.0:1788651199.093891:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788651199.093961:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 397: rc = 0 00100000:10000000:0.0:1788651199.094318:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 397: rc = 0 00100000:10000000:0.0:1788651199.094435:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 397: rc = 0 00100000:10000000:0.0:1788651199.094716:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 399: rc = 0 00100000:10000000:0.0:1788651199.097322:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:0.0:1788651199.097437:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:0.0:1788651199.098478:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 476: rc = 0 00100000:10000000:0.0:1788651199.098849:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 476: rc = 0 00100000:10000000:0.0:1788651199.099088:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 476: rc = 0 00100000:10000000:0.0:1788651199.099305:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 476: rc = 0 00100000:10000000:0.0:1788651199.099614:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 476: rc = 0 00100000:10000000:0.0:1788651199.099983:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 476: rc = 0 00100000:10000000:0.0:1788651199.100388:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 476: rc = 0 00100000:10000000:0.0:1788651199.101418:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 476: rc = 0 00100000:10000000:0.0:1788651199.101756:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 476: rc = 0 00100000:10000000:0.0:1788651199.102013:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 476: rc = 0 00100000:10000000:0.0:1788651199.102355:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 476: rc = 0 00100000:10000000:0.0:1788651199.102599:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 476: rc = 0 00100000:10000000:0.0:1788651199.102988:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:0.0:1788651199.103280:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:0.0:1788651199.103608:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:0.0:1788651199.103853:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:0.0:1788651199.104101:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:0.0:1788651199.104999:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:0.0:1788651199.105417:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:0.0:1788651199.105869:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:0.0:1788651199.106296:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:0.0:1788651199.106561:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:0.0:1788651199.107096:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:0.0:1788651199.107519:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:0.0:1788651199.108462:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:0.0:1788651199.109004:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:0.0:1788651199.109406:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:0.0:1788651199.109727:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:0.0:1788651199.110267:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:0.0:1788651199.110546:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:0.0:1788651199.111073:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:0.0:1788651199.111984:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:0.0:1788651199.112393:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:0.0:1788651199.112704:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:0.0:1788651199.113238:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:0.0:1788651199.113500:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:0.0:1788651199.113973:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:0.0:1788651199.114324:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:0.0:1788651199.114595:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:0.0:1788651199.115023:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:0.0:1788651199.115406:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:1.0:1788651199.115802:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:1.0:1788651199.116411:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:1.0:1788651199.116706:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:1.0:1788651199.117270:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 647: rc = 0 00100000:10000000:1.0:1788651199.117760:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788651199.117942:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 474: rc = 0 00100000:10000000:1.0:1788651199.118159:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788651199.118225:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 474: rc = 0 00100000:10000000:1.0:1788651199.118412:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788651199.118465:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 474: rc = 0 00100000:10000000:1.0:1788651199.118777:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788651199.118843:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:1.0:1788651199.119024:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788651199.120340:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:1.0:1788651199.120628:0:14383:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788651199.120697:0:14383:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00000020:00000080:1.0:1788651199.121071:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788651199.121083:0:14383:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788651199.121094:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887978214 00000020:01000004:1.0:1788651199.121102:0:14383:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788651199.121129:0:14383:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788651199.121135:0:14383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93be7c1e4800 from MGS 00000020:01000004:1.0:1788651199.121138:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788651199.121149:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93be58bfcd40) 00000020:00000080:1.0:1788651199.121159:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788651199.121213:0:14383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7c1e4800 from MGS, refs=2 00080000:01000000:1.0:1788651199.121217:0:14383:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788651199.121222:0:14383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887978222 00000100:00100000:1.0:1788651199.121313:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788651199.121866:0:14383:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788651199.121873:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788651199.122693:0:14383:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788651199.122699:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788651199.123474:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651199.123660:0:14383:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788651199.123666:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788651199.124487:0:14383:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788651199.124495:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788651199.124804:0:14383:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788651199.124810:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788651199.125743:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.125747:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.125752:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.126699:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.127364:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.127367:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651199.130585:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788651199.137162:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788651199.165369:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788651199.165814:0:14383:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788651199.166029:0:14383:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788651199.172270:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788651199.172552:0:14383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788651199.172664:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788651199.173693:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788651199.174565:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651199.175491:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788651199.175500:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788651199.185723:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788651199.185745:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788651199.188375:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788651199.188389:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788651199.189948:0:14397:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788651199.190077:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788651199.190098:0:14383:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.121@tcp' 00000020:01000004:2.0:1788651199.190100:0:14383:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788651199.192470:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.121@tcp (typ=mgc) 00000020:00000080:2.0:1788651199.192488:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.121@tcp (ffff93be7bba0000) 00000020:00000080:2.0:1788651199.192505:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788651199.192668:0:14383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93bd4219c000@MGC192.168.203.121@tcp: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1788651199.192821:0:14383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.121@tcp-0 is initialized 00000040:01000000:2.0:1788651199.192827:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788651199.196418:0:14398:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788651199.196537:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.121@tcp (uuid f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0) 00000020:00000080:0.0:1788651199.196560:0:14383:0:(genops.c:1385:class_connect()) connect: client f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0, cookie 0x84a2fba887978230 00000100:00080000:0.0:1788651199.196573:0:14383:0:(import.c:545:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788651199.196581:0:14383:0:(import.c:665:import_select_connection()) MGC192.168.203.121@tcp: import ffff93bd4219c000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1788651199.196628:0:14383:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be75404000 x1875536408299520/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788651199.196653:0:14383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0->MGS 00000020:01000004:0.0:1788651199.196685:0:14383:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788651199.196690:0:14383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788651199.196702:0:14383:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93be456d3380) 00000020:00000080:0.0:1788651199.196713:0:14383:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788651199.198627:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3305:1875536408299520:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788651199.198702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651199.200181:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408299520 00000100:00100000:3.0:1788651199.200196:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408299520 00000100:00100000:3.0:1788651199.200241:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651199.200271:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875536408299520:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788651199.200302:0:14394:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1788651199.200335:0:14394:0:(genops.c:1385:class_connect()) connect: client f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0, cookie 0x84a2fba88797823e 00000100:00080000:3.0:1788651199.200539:0:14394:0:(import.c:65:import_set_state_nolock()) ffff93be7bb5c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651199.200632:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+5:3305:x1875536408299520:12345-0@lo:250:mount.lustre.0 Request processed in 370us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651199.200640:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651199.200694:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788651199.200704:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1788651199.200712:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788651199.200717:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788651199.200721:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93bd4219c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788651199.200724:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788651199.200734:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788651199.202084:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3305:1875536408299520:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788651199.212812:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651199.213260:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788651199.213267:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788651199.219544:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788651199.219560:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788651199.219957:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788651199.219964:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788651199.220935:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651199.221614:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788651199.221621:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788651199.223478:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788651199.223491:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788651199.267403:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651199.267594:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788651199.267601:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788651199.268938:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788651199.268949:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788651199.269975:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651199.270215:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788651199.270220:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788651199.270820:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788651199.270827:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788651199.271534:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651199.271686:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788651199.271691:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788651199.272339:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788651199.272355:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788651199.276553:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651199.276740:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788651199.276747:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788651199.277647:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788651199.277656:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788651199.293557:0:14383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651199.293832:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788651199.293839:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788651199.295555:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788651199.295572:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788651199.296550:0:14383:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788651199.296560:0:14383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788651199.297583:0:14383:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788651199.297606:0:14383:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788651199.297612:0:14383:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788651199.297862:0:14383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788651199.297896:0:14383:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788651199.297900:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788651199.297902:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788651199.297903:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651199.297904:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651199.297906:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651199.297907:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651199.297908:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788651199.297910:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788651199.297912:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651199.297913:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788651199.297915:0:14383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788651199.297918:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788651199.297919:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788651199.297920:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651199.297921:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651199.297922:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651199.297924:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651199.297925:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788651199.297926:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788651199.297927:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651199.297928:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788651199.297957:0:14383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788651199.297978:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408299648:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788651199.298048:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651199.298166:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4449f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651199.298407:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408299648 00000100:00100000:0.0:1788651199.298415:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408299648 00000100:00100000:0.0:1788651199.298490:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651199.298500:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+5:14383:x1875536408299648:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788651199.298550:0:14396:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788651199.298554:0:14396:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788651199.298557:0:14396:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788651199.298975:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788651199.299544:0:14396:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788651199.300878:0:14418:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788651199.300884:0:14418:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788651199.300887:0:14418:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788651199.300919:0:14418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788651199.303513:0:14396:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788651199.303526:0:14396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788651199.314676:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+5:14383:x1875536408299648:12345-0@lo:253:mount.lustre.0 Request processed in 16167us (16618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.314695:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651199.314798:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408299648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788651199.314813:0:14383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788651199.314816:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788651199.314818:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788651199.314819:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651199.314820:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651199.314822:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651199.314823:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651199.314824:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788651199.314826:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788651199.314827:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651199.314828:0:14383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788651199.314847:0:14383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93be7c1e4800 from lustre-MDT0000 10000000:01000000:3.0:1788651199.314874:0:14383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788651199.314878:0:14383:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788651199.314883:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93be7bba0000 10000000:01000000:3.0:1788651199.314887:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788651199.314895:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93be7bba0000 from 1 10000000:01000000:3.0:1788651199.314898:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788651199.314932:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.314943:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.314952:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651199.314973:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408299776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788651199.315011:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651199.315049:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be430a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.315160:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408299776 00000100:00100000:2.0:1788651199.315167:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408299776 00000100:00100000:2.0:1788651199.315215:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651199.315224:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+5:14383:x1875536408299776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.315236:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651199.315249:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618bc00/0x84a2fba88797824c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887978245 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.315271:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618bc00/0x84a2fba88797824c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887978245 expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.315282:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618bc00/0x84a2fba88797824c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978245 expref: 6 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.315306:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618bc00, rc 0) 00000100:00100000:2.0:1788651199.315355:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+6:14383:x1875536408299776:12345-0@lo:101:mount.lustre.0 Request processed in 132us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.315361:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651199.315411:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408299776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651199.315431:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.315439:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651199.315483:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408299904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788651199.315508:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651199.315571:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be430a5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.315609:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408299904 00000100:00100000:1.0:1788651199.315613:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408299904 00000100:00100000:1.0:1788651199.315678:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788651199.315685:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+6:14383:x1875536408299904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651199.316152:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+6:14383:x1875536408299904:12345-0@lo:501:mount.lustre.0 Request processed in 464us (641us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788651199.316161:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651199.316381:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408299904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788651199.316407:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788651199.316419:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.316428:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651199.316436:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93be7c1e4800 10000000:01000000:3.0:1788651199.316440:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788651199.316444:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93be7c1e4800 10000000:01000000:3.0:1788651199.316447:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788651199.316450:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93be7c1e4800 from 1 10000000:01000000:3.0:1788651199.316453:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788651199.316473:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.316480:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.316500:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651199.316515:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788651199.316542:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651199.316572:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be430a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.317178:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408300032 00000100:00100000:2.0:1788651199.317185:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408300032 00000100:00100000:2.0:1788651199.317216:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651199.317224:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+6:14383:x1875536408300032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.317235:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651199.317248:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618aa00/0x84a2fba88797825a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887978253 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.317453:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618aa00/0x84a2fba88797825a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887978253 expref: 7 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.317466:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618aa00/0x84a2fba88797825a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978253 expref: 7 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.317474:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618aa00, rc 0) 00000100:00100000:2.0:1788651199.317521:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+7:14383:x1875536408300032:12345-0@lo:101:mount.lustre.0 Request processed in 297us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.317526:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788651199.317622:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651199.317636:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797825a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.317645:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797825a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651199.317660:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788651199.317672:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797825a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.317679:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56dc00/0x84a2fba887978253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797825a expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651199.317686:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788651199.317702:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788651199.317707:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93be7c1e4800 10000000:01000000:3.0:1788651199.317709:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788651199.317713:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788651199.317715:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788651199.317732:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.317749:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.317757:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651199.317772:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788651199.317801:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651199.317835:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be430a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.318038:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408300160 00000100:00100000:2.0:1788651199.318042:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408300160 00000100:00100000:2.0:1788651199.318073:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651199.318080:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+7:14383:x1875536408300160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.318088:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651199.318104:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a600/0x84a2fba887978268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887978261 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.318156:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a600/0x84a2fba887978268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887978261 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.318164:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a600/0x84a2fba887978268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978261 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.318170:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a600, rc 0) 00000100:00100000:2.0:1788651199.318198:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+8:14383:x1875536408300160:12345-0@lo:101:mount.lustre.0 Request processed in 119us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.318204:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788651199.318283:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788651199.318300:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978268 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651199.318307:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978268 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651199.318365:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651199.318391:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651199.318415:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be701a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.318605:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408300288 00000100:00100000:2.0:1788651199.318610:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408300288 00000100:00100000:2.0:1788651199.318628:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651199.318634:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+8:14383:x1875536408300288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651199.319070:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14383:x1875536408300288:12345-0@lo:501:mount.lustre.0 Request processed in 434us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.319088:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788651199.319590:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651199.319632:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651199.319679:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651199.319743:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be701a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.319782:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408300416 00000100:00100000:2.0:1788651199.319787:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408300416 00000100:00100000:2.0:1788651199.319855:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788651199.319863:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14383:x1875536408300416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651199.320589:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14383:x1875536408300416:12345-0@lo:503:mount.lustre.0 Request processed in 723us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.320597:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788651199.320708:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408300416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651199.321069:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14419:1875536408300544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651199.321233:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651199.321392:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be701a20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.321441:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408300544 00000100:00100000:1.0:1788651199.321448:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408300544 00000100:00100000:1.0:1788651199.321523:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651199.321532:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14419:x1875536408300544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.321800:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14419:x1875536408300544:12345-0@lo:502:llog_process_th.0 Request processed in 269us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.321807:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788651199.321966:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14419:1875536408300544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651199.321994:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651199.322004:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.322006:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788651199.322010:0:14419:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788651199.322013:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651199.322027:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93be456d0000) 00000020:00000080:0.0:1788651199.322043:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788651199.322049:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788651199.322358:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788651199.322367:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887978276 00000020:00000080:0.0:1788651199.322563:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788651199.322568:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651199.322572:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.322574:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788651199.322577:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651199.322580:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.322582:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788651199.322585:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651199.322592:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93be456d4d40) 00000020:00000080:0.0:1788651199.322603:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788651199.322607:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788651199.322609:0:14419:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788651199.322611:0:14419:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788651199.322617:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788651199.322654:0:14419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7c1e4800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788651199.322676:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93be81de4d40) 00000020:00000080:0.0:1788651199.322685:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788651199.322734:0:14419:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788651199.322740:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba88797828b 00000020:00000080:0.0:1788651199.322872:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788651199.322878:0:14419:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788651199.322883:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x84a2fba887978292 00080000:01000000:0.0:1788651199.322887:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788651199.322891:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba887978299 00010000:00010000:3.0:1788651199.419458:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788651199.420095:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788651199.420765:0:14419:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788651199.421741:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93be76594d40) 00000020:00000080:3.0:1788651199.421765:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788651199.422012:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788651199.422020:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba8879782a7 00000020:00000080:0.0:1788651199.426026:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788651199.434370:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x84a2fba8879782ae 00000020:00000080:3.0:1788651199.436334:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788651199.436357:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651199.436364:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651199.436367:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788651199.436378:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788651199.436381:0:14419:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788651199.436383:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788651199.436384:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788651199.436385:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788651199.436388:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651199.436389:0:14419:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788651199.436391:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651199.436395:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651199.436397:0:14419:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788651199.436407:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788651199.436452:0:14419:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788651199.436469:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651199.436472:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651199.436474:0:14419:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788651199.436477:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788651199.436480:0:14419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788651199.436485:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651199.436486:0:14419:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788651199.436488:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788651199.436494:0:14419:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:3.0:1788651199.436518:0:14419:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788651199.436521:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788651199.436536:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93be76593380) 00000020:00000080:3.0:1788651199.436553:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788651199.436558:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788651199.436609:0:14419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788651199.436614:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788651199.436620:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba8879782bc 00010000:00080000:3.0:1788651199.436649:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be5b6a7800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1788651199.436864:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788651199.439470:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788651199.439534:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788651199.441538:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651199.441608:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788651199.441675:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788651199.443492:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788651199.443506:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788651199.447164:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651199.447179:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788651199.447213:0:14419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788651199.447233:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879782c3 00000100:00080000:1.0:1788651199.447244:0:14419:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788651199.447251:0:14419:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93be5b6a7800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788651199.447294:0:14419:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be74f94a80 x1875536408300672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788651199.447315:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788651199.447387:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651199.447392:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651199.447393:0:14419:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788651199.447396:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788651199.447399:0:14419:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788651199.447401:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788651199.447403:0:14419:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788651199.447404:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788651199.447407:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651199.447408:0:14419:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788651199.447411:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788651199.447415:0:14419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788651199.447419:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651199.447420:0:14419:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788651199.447423:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788651199.447427:0:14419:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:1.0:1788651199.447451:0:14419:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788651199.447454:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788651199.447465:0:14419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93be58bfb380) 00000020:00000080:1.0:1788651199.447476:0:14419:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788651199.447481:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788651199.447535:0:14419:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788651199.447541:0:14419:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788651199.447546:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84a2fba8879782d1 00010000:00080000:1.0:1788651199.447574:0:14419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be456b5800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1788651199.447774:0:14419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788651199.447963:0:14419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788651199.447986:0:14419:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788651199.448525:0:14419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788651199.448589:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788651199.448662:0:14419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788651199.448956:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408300672:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788651199.449008:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875536408300672 offset 0 length 520: 4 00000040:00080000:3.0:1788651199.449729:0:14425:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788651199.449735:0:14425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788651199.451826:0:14419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651199.451841:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788651199.451876:0:14419:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788651199.451898:0:14419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879782d8 00000100:00080000:2.0:1788651199.451909:0:14419:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788651199.451915:0:14419:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93be456b5800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1788651199.451975:0:14419:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be7556bb80 x1875536408300800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788651199.452008:0:14419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788651199.452061:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651199.452066:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651199.452068:0:14419:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788651199.452070:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651199.452074:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651199.452075:0:14419:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788651199.452078:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788651199.452080:0:14419:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788651199.452082:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651199.452084:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651199.452085:0:14419:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788651199.452088:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651199.452090:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651199.452091:0:14419:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788651199.452094:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788651199.452152:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14419:1875536408300928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651199.452230:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.452264:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488add80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651199.452326:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408300800:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788651199.452376:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875536408300800 offset 0 length 520: 4 00000100:00100000:1.0:1788651199.452478:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408300928 00000100:00100000:1.0:1788651199.452492:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408300928 00000100:00100000:1.0:1788651199.452536:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788651199.452546:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14419:x1875536408300928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.452773:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14419:x1875536408300928:12345-0@lo:502:llog_process_th.0 Request processed in 229us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.452781:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788651199.452957:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14419:1875536408300928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651199.452983:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651199.452988:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651199.452990:0:14419:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788651199.452994:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788651199.453516:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788651199.453537:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788651199.453558:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978268 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.453569:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56d400/0x84a2fba887978261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978268 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651199.453577:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be7c1e4800 from 1 10000000:01000000:1.0:1788651199.453580:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788651199.453609:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.453617:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.453626:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651199.453645:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788651199.453683:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651199.453708:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.453789:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301056 00000100:00100000:2.0:1788651199.453795:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301056 00000100:00100000:2.0:1788651199.453834:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788651199.453852:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+9:14383:x1875536408301056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.453862:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651199.453876:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879782df expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.453898:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879782df expref: 10 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.454281:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879782df expref: 10 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.454292:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ba00, rc 0) 00000100:00100000:2.0:1788651199.454429:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+10:14383:x1875536408301056:12345-0@lo:101:mount.lustre.0 Request processed in 578us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.454436:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788651199.456642:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651199.456683:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651199.456696:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.457884:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301184:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788651199.458098:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.458327:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651199.458389:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301184 00000100:00100000:0.0:1788651199.458398:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301184 00000100:00100000:0.0:1788651199.462094:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651199.462146:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+10:14383:x1875536408301184:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788651199.462178:0:14395:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788651199.462201:0:14395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788651199.462328:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+10:14383:x1875536408301184:12345-0@lo:256:mount.lustre.0 Request processed in 221us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651199.462338:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788651199.462457:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301184:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788651199.463103:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788651199.463147:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.463158:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651199.463167:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7c1e4800 from 1 10000000:01000000:2.0:1788651199.463170:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788651199.463214:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.463223:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.463233:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.463254:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788651199.463295:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.465166:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.465579:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301312 00000100:00100000:1.0:1788651199.465603:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301312 00000100:00100000:1.0:1788651199.465647:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651199.465656:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+10:14383:x1875536408301312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788651199.465671:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651199.465690:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879782ed expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.465715:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879782ed expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.465727:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879782ed expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.465736:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d400, rc 0) 00000100:00100000:1.0:1788651199.465845:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408301312:12345-0@lo:101:mount.lustre.0 Request processed in 189us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.465852:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788651199.467195:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.467220:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.467232:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.467309:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651199.467400:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.467480:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651199.470151:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301440 00000100:00100000:3.0:1788651199.470167:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301440 00000100:00100000:1.0:1788651199.471040:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651199.471059:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408301440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651199.471544:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408301440:12345-0@lo:501:mount.lustre.0 Request processed in 490us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.471554:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651199.471689:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651199.471748:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651199.471799:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651199.471836:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5970cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.471893:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301568 00000100:00100000:1.0:1788651199.471899:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301568 00000100:00100000:1.0:1788651199.471950:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651199.471957:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408301568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788651199.472096:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408301568:12345-0@lo:503:mount.lustre.0 Request processed in 139us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.472136:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788651199.472328:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651199.474514:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14427:1875536408301696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651199.474596:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651199.474679:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5970c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.475375:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301696 00000100:00100000:1.0:1788651199.475384:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301696 00000100:00100000:1.0:1788651199.475465:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651199.475476:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14427:x1875536408301696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.475771:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14427:x1875536408301696:12345-0@lo:502:llog_process_th.0 Request processed in 296us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.475779:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788651199.476423:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14427:1875536408301696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651199.476461:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651199.476471:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.476473:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788651199.476479:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be7c1e4800 00000020:00000080:0.0:1788651199.476482:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788651199.476489:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651199.476491:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.476493:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788651199.476495:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651199.476497:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.476498:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788651199.476501:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be7c1e4800 00000020:00000080:0.0:1788651199.476502:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788651199.476600:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651199.476604:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.476612:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788651199.476616:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651199.476619:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651199.476620:0:14427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788651199.476623:0:14427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93be7c1e4800 00000020:00000080:0.0:1788651199.476626:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651199.493257:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14427:1875536408301824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.493352:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651199.493396:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301824 00000100:00100000:1.0:1788651199.493404:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301824 00000100:00100000:1.0:1788651199.493461:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651199.493471:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14427:x1875536408301824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.493671:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14427:x1875536408301824:12345-0@lo:502:llog_process_th.0 Request processed in 200us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.493679:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651199.493728:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.493749:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14427:1875536408301824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651199.493777:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651199.493784:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651199.493786:0:14427:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788651199.493792:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788651199.493948:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788651199.493969:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651199.493988:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.493998:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651199.494053:0:14383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788651199.494056:0:14383:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93be7c1e4800 10000000:01000000:2.0:1788651199.494059:0:14383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93be7c1e4800 10000000:01000000:2.0:1788651199.494063:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788651199.494069:0:14383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be7c1e4800 from 1 10000000:01000000:2.0:1788651199.494072:0:14383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788651199.494096:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.494139:0:14383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.494149:0:14383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.494165:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788651199.494196:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.494217:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44181e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.494237:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408301952 00000100:00100000:2.0:1788651199.494241:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408301952 00000100:00100000:2.0:1788651199.494268:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651199.494275:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408301952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.494283:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651199.494294:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a000/0x84a2fba887978302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879782fb expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.494314:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a000/0x84a2fba887978302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879782fb expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.494332:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a000/0x84a2fba887978302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879782fb expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.494351:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a000, rc 0) 00000100:00100000:2.0:1788651199.494380:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14383:x1875536408301952:12345-0@lo:101:mount.lustre.0 Request processed in 106us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.494386:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651199.494417:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408301952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651199.494430:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978302 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.494438:0:14383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978302 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.494477:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408302080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651199.494502:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.494515:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44181e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.494526:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302080 00000100:00100000:2.0:1788651199.494529:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302080 00000100:00100000:2.0:1788651199.494544:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651199.494549:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14383:x1875536408302080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651199.494747:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14383:x1875536408302080:12345-0@lo:501:mount.lustre.0 Request processed in 196us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.494754:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651199.494783:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408302080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651199.494817:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408302208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651199.494851:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.494862:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44181e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.494873:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302208 00000100:00100000:2.0:1788651199.494876:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302208 00000100:00100000:2.0:1788651199.494890:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651199.494895:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14383:x1875536408302208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651199.495024:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14383:x1875536408302208:12345-0@lo:503:mount.lustre.0 Request processed in 127us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.495030:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651199.495076:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408302208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788651199.496177:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14432:1875536408302336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.496238:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651199.496276:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be74fbc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788651199.496332:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302336 00000100:00100000:2.0:1788651199.496338:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302336 00000100:00100000:2.0:1788651199.496379:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651199.496387:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14432:x1875536408302336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651199.496596:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14432:x1875536408302336:12345-0@lo:502:llog_process_th.0 Request processed in 210us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651199.496604:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788651199.496681:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14432:1875536408302336:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788651199.496736:0:14432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788651199.496752:0:14432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93be58bf8000) 00000020:00000080:1.0:1788651199.496784:0:14432:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788651199.498034:0:14432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7c1e4800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788651199.498042:0:14432:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93be7c1e4800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788651199.498045:0:14432:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be7c1e4800 4 00010000:00080000:1.0:1788651199.498082:0:14432:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be44cd3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1788651199.503616:0:14432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788651199.503825:0:14432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788651199.503864:0:14432:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788651199.503877:0:14432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x84a2fba887978310 00000100:00080000:1.0:1788651199.503888:0:14432:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788651199.503894:0:14432:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93be44cd3800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788651199.503947:0:14432:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be74f96680 x1875536408302464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651199.503986:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408302464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788651199.504067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788651199.504139:0:14432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788651199.504291:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302464 00000100:00100000:0.0:1788651199.504299:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302464 00000100:00100000:0.0:1788651199.504336:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651199.504354:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875536408302464:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788651199.504408:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875536408302464:12345-0@lo:38:llog_process_th.0 Request processed in 54us (341us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788651199.504416:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651199.507514:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788651199.507529:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be44cd3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788651199.507535:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788651199.507540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408302464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788651199.508294:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14432:1875536408302592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.508381:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651199.508423:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302592 00000100:00100000:1.0:1788651199.508429:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302592 00000100:00100000:1.0:1788651199.508480:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651199.508490:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14432:x1875536408302592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651199.508722:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14432:x1875536408302592:12345-0@lo:502:llog_process_th.0 Request processed in 231us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.508730:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651199.508768:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8053b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788651199.508785:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14432:1875536408302592:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788651199.508809:0:14432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788651199.510748:0:14383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788651199.510778:0:14383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788651199.510806:0:14383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978302 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651199.510818:0:14383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618b600/0x84a2fba8879782fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978302 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788651199.510863:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788651199.510865:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788651199.510866:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651199.510868:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651199.510869:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651199.510870:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651199.510871:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788651199.510873:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788651199.510875:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651199.510876:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788651199.510880:0:14383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788651199.510883:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788651199.510887:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788651199.510888:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651199.510889:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651199.510890:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651199.510891:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651199.510892:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788651199.510893:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788651199.510894:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651199.510894:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788651199.513158:0:14383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788651199.513184:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408302720:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788651199.513269:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651199.513314:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5970c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788651199.513391:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302720 00000100:00100000:3.0:1788651199.513400:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302720 00000100:00100000:3.0:1788651199.513454:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651199.513465:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14383:x1875536408302720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788651199.513494:0:14394:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788651199.513509:0:14394:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788651199.555099:0:14394:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788651199.555216:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788651199.555223:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788651199.555244:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.555263:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879782df expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.555273:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.555329:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879782df expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.555356:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879782df expref: 12 pid: 14394 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.555374:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875536408302848:0@lo:104: 00000100:00100000:2.0:1788651199.555441:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651199.555530:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff93bd410860c0 going to sleep for 11 seconds 20000000:01000000:3.0:1788651199.555573:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788651199.559421:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302848 00000100:00100000:1.0:1788651199.559435:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302848 00000100:00100000:1.0:1788651199.559490:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651199.559501:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14417:x1875536408302848:12345-0@lo:104: 00010000:00010000:1.0:1788651199.559520:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.559615:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788651199.559622:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14417:x1875536408302848:12345-0@lo:104: Request processed in 124us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.559628:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788651199.559648:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651199.559655:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.559662:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9d200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651199.559666:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.559692:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651199.559700:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651199.559705:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651199.559742:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.559749:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651199.559769:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.559775:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d200/0x84a2fba8879782df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879782e6 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.559791:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.559793:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651199.559794:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651199.559827:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408302976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651199.559865:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651199.559930:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408302976 00000100:00100000:1.0:1788651199.559934:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408302976 00010000:00010000:1.0:1788651199.559952:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879782df expref: 13 pid: 14394 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651199.559972:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651199.559978:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+13:3309:x1875536408302976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651199.559995:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651199.560000:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879782df expref: 13 pid: 14394 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560010:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879782df expref: 13 pid: 14394 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560027:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560035:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788651199.560049:0:14386:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004827348s 00010000:00010000:1.0:1788651199.560054:0:14386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560060:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560067:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560073:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560078:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651199.560083:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560091:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560150:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651199.560161:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651199.560192:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+13:3309:x1875536408302976:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651199.560199:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651199.560249:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408302976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651199.560409:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618ba00/0x84a2fba8879782e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879782df expref: 12 pid: 14394 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651199.560421:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875536408302848:0@lo:104: 00010000:00010000:2.0:1788651199.560434:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.560444:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.560451:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651199.560457:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618b400/0x84a2fba887978317 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651199.561940:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14383:x1875536408302720:12345-0@lo:253:mount.lustre.0 Request processed in 48469us (48664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651199.561952:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788651199.562045:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14383:1875536408302720:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788651199.562059:0:14383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788651199.562063:0:14383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788651199.562064:0:14383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788651199.562065:0:14383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651199.562067:0:14383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651199.562068:0:14383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651199.562069:0:14383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651199.562070:0:14383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788651199.562072:0:14383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788651199.562073:0:14383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651199.562075:0:14383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788651199.562088:0:14383:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788651199.567897:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788651199.568072:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788651199.568591:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788651199.568757:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788651199.569019:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788651199.569307:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788651199.569972:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788651199.570237:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788651199.570532:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788651199.570755:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788651199.571013:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788651199.571376:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788651199.596559:0:14383:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788651199.597387:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788651199.597703:0:14440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788651199.599182:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788651199.599319:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788651199.599767:0:14383:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788651199.599774:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788651199.599899:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788651199.600596:0:14439:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788651199.600602:0:14439:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1788651199.600835:0:14440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651199.600889:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788651199.601962:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788651199.602006:0:14383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788651199.603128:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788651199.603186:0:14440:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788651199.603190:0:14440:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1788651199.603720:0:14383:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788651199.608417:0:14383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788651199.636373:0:14383:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788651199.636430:0:14383:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb91e01557988 00100000:10000000:1.0:1788651199.636439:0:14383:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788651199.640081:0:14383:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788651199.640100:0:14383:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788651199.640278:0:14383:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788651199.640300:0:14383:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788651200.198418:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651200.518039:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788651201.220327:0:14398:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788651201.220344:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be7c1e4800 from 6 10000000:01000000:1.0:1788651201.220350:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788651201.220393:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651201.220405:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651201.220416:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651201.220442:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408303104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651201.220522:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651201.220583:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651201.221077:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303104 00000100:00100000:3.0:1788651201.221088:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303104 00000100:00100000:3.0:1788651201.221175:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651201.221185:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14398:x1875536408303104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651201.221198:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651201.221214:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797831e expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651201.221237:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797831e expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651201.221248:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797831e expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651201.221256:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d200, rc 0) 00000100:00100000:3.0:1788651201.221303:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408303104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651201.221310:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788651201.221475:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408303104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651201.221493:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651201.221502:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651201.221572:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408303232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788651201.221622:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651201.221653:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be753e5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651201.221896:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303232 00000100:00100000:3.0:1788651201.221901:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303232 00000100:00100000:3.0:1788651201.221937:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651201.221950:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408303232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788651201.221965:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788651201.221979:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788651201.221983:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788651201.222072:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408303232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651201.222079:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788651201.222218:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408303232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788651201.222261:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788651201.222269:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651201.222278:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651201.225941:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788651201.541264:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788651202.244202:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651203.268401:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788651203.703841:0:14682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788651204.293669:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651204.996807:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788651204.996815:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788651204.996818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788651204.996820:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788651204.996823:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788651204.996826:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788651204.996830:0:38:0:(import.c:65:import_set_state_nolock()) ffff93be44cd3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788651204.996842:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93be44cd3800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788651204.996864:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be74f95500 x1875536408303488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651204.996909:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408303488:0@lo:38:kworker.0 00000100:00100000:1.0:1788651204.996986:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651204.997081:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651204.997089:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408303360:0@lo:400:kworker.0 00000100:00100000:0.0:1788651204.997419:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303488 00000100:00100000:0.0:1788651204.997427:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303488 00000100:00100000:0.0:1788651204.997464:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651204.997472:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875536408303488:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788651204.997493:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:0.0:1788651204.997530:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x84a2fba88797832c 00000004:00100000:0.0:1788651204.999408:0:14403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788651204.999574:0:14403:0:(import.c:65:import_set_state_nolock()) ffff93be43848000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651204.999765:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875536408303488:12345-0@lo:38:kworker.0 Request processed in 2291us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651204.999775:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651205.000132:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651205.000446:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303360 00000100:00100000:0.0:1788651205.000453:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303360 00000100:00100000:0.0:1788651205.000489:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651205.000496:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:3307:x1875536408303360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651205.000538:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:3307:x1875536408303360:12345-0@lo:400:kworker.0 Request processed in 42us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651205.000544:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788651205.000797:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408303360:0@lo:400:kworker.0 00010000:00080000:3.0:1788651205.000987:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93be74f95500 x1875536408303488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788651205.001004:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788651205.001012:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788651205.001017:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788651205.001020:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be44cd3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788651205.001026:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875536408303488:0@lo:38:kworker.0 00010000:00010000:1.0:1788651205.319794:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788651206.305783:0:14833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff35279320 20000000:00000080:3.0:1788651206.305803:0:14833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93be6e2f3800 uarg=0000000000000000 20000000:01000000:3.0:1788651206.305835:0:14833:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788651206.305841:0:14833:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788651206.305846:0:14833:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788651206.306660:0:14834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788651206.306830:0:14833:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788651206.323498:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788651206.323616:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651206.323638:0:14833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879782ed expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651206.323646:0:14833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651206.323688:0:14833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879782ed expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651206.323705:0:14833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879782ed expref: 11 pid: 14396 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651206.323719:0:14833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14833:1875536408303616:0@lo:104: 00000100:00100000:0.0:1788651206.323778:0:14833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651206.323830:0:14833:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be412eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651206.323930:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303616 00000100:00100000:3.0:1788651206.323939:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303616 00000100:00100000:3.0:1788651206.323983:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651206.323993:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14833:x1875536408303616:12345-0@lo:104: 00010000:00010000:3.0:1788651206.324007:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651206.324083:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651206.324089:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14833:x1875536408303616:12345-0@lo:104: Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651206.324095:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788651206.324187:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651206.324195:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.324203:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:2.0:1788651206.324207:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.324217:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651206.324225:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651206.324230:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788651206.324277:0:14389:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.324284:0:14389:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651206.324316:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.324324:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be4618b200/0x84a2fba8879782ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879782f4 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.324340:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651206.324342:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651206.324345:0:14833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14833:1875536408303616:0@lo:104: 00010000:00010000:2.0:1788651206.324346:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651206.324360:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408303744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651206.324371:0:14833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651206.324393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651206.324430:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303744 00000100:00100000:1.0:1788651206.324435:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303744 00010000:00010000:1.0:1788651206.324459:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879782ed expref: 12 pid: 14396 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651206.324493:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651206.324500:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:3307:x1875536408303744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651206.324511:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651206.324515:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879782ed expref: 12 pid: 14396 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324525:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879782ed expref: 12 pid: 14396 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324538:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9d400/0x84a2fba8879782f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879782ed expref: 12 pid: 14396 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324562:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324570:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324582:0:14386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324589:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324597:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324604:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324609:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651206.324614:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324622:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324644:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.324654:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651206.324690:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:3307:x1875536408303744:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651206.324704:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788651206.324975:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408303744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651206.324994:0:14833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.325023:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651206.325029:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be75860000/0x84a2fba887978333 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651206.340516:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651207.364847:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788651207.812592:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651207.812601:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7c1e4800 from 10 10000000:01000000:3.0:1788651207.812606:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651207.812649:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651207.812660:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651207.812671:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651207.812696:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408303872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651207.812768:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651207.812815:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be503fecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651207.812958:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408303872 00000100:00100000:0.0:1788651207.812966:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408303872 00000100:00100000:0.0:1788651207.813014:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651207.813023:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+11:14398:x1875536408303872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651207.813035:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651207.813048:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797833a expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651207.813071:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797833a expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651207.813081:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797833a expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651207.813090:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861c00, rc 0) 00000100:00100000:0.0:1788651207.813149:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408303872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651207.813156:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651207.813203:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408303872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651207.813217:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651207.813226:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651207.813275:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408304000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651207.813308:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651207.813322:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be412eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651207.813344:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408304000 00000100:00100000:0.0:1788651207.813347:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408304000 00000100:00100000:0.0:1788651207.813368:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788651207.813374:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408304000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651207.813579:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408304000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651207.813585:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788651207.813611:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408304000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651207.813636:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408304128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651207.813669:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651207.813680:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be805643c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651207.813690:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408304128 00000100:00100000:0.0:1788651207.813694:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408304128 00000100:00100000:0.0:1788651207.813713:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788651207.813719:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408304128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651207.813851:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:14398:x1875536408304128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651207.813858:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788651207.813895:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408304128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788651207.814559:0:14896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788651207.814609:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788651207.814622:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651207.814630:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651207.814640:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651208.388543:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651209.092225:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651199/real 1788651199] req@ffff93be7556bb80 x1875536408300800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651209.092258:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93be7556bb80 x1875536408300800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651209.092270:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651199/real 1788651199] req@ffff93be74f94a80 x1875536408300672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651209.092294:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93be74f94a80 x1875536408300672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788651209.092312:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788651209.092332:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788651209.092336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408300800:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788651209.092343:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be5b6a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788651209.092347:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788651209.092350:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408300672:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788651209.092506:0:13952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788651209.092511:0:13952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788651209.092514:0:13952:0:(import.c:65:import_set_state_nolock()) ffff93be5b6a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651209.092519:0:13952:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1788651209.092524:0:13952:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788651209.092531:0:13952:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93be5b6a7800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1788651209.092550:0:13952:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be75405500 x1875536408304384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788651209.092562:0:13952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788651209.092565:0:13952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788651209.092567:0:13952:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651209.092570:0:13952:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:0.0:1788651209.092573:0:13952:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788651209.092576:0:13952:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93be456b5800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1788651209.092599:0:13952:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be75405c00 x1875536408304512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788651209.092727:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408304640:0@lo:400:kworker.0 00000100:00100000:3.0:1788651209.092806:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651209.092875:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651209.092881:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408304256:0@lo:400:kworker.0 00000100:00100000:3.0:1788651209.092908:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651209.093153:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408304384:0@lo:8:kworker.0 00000400:00000100:2.0:1788651209.093195:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875536408304384 offset 0 length 520: 4 00000100:00100000:2.0:1788651209.093211:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408304512:0@lo:8:kworker.0 00000400:00000100:2.0:1788651209.093229:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875536408304512 offset 0 length 520: 4 00000100:00100000:0.0:1788651209.093371:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408304640 00000100:00100000:0.0:1788651209.093378:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408304640 00000100:00100000:0.0:1788651209.093440:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651209.093450:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408304640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651209.093500:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408304640:12345-0@lo:400:kworker.0 Request processed in 52us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651209.093506:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651209.093529:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408304256 00000100:00100000:0.0:1788651209.093539:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408304256 00000100:00100000:0.0:1788651209.093566:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788651209.093572:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:3309:x1875536408304256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651209.093735:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:3309:x1875536408304256:12345-0@lo:400:kworker.0 Request processed in 163us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651209.093742:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788651209.093785:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408304256:0@lo:400:kworker.0 00010000:00080000:0.0:1788651209.093802:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93be75404a80 x1875536408304640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651209.093814:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408304640:0@lo:400:kworker.0 00010000:00010000:3.0:1788651209.413350:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651210.440018:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788651211.026592:0:15081:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788651211.026610:0:15081:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788651211.026774:0:15081:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93be7be43800 00000020:01000004:3.0:1788651211.026796:0:15081:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788651211.026812:0:15081:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788651211.026831:0:15081:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93be765919c0) 00000020:00000080:3.0:1788651211.026871:0:15081:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788651211.056740:0:15081:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788651211.057178:0:15081:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788651211.057947:0:15081:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788651211.058387:0:15081:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788651211.063916:0:15081:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788651211.064460:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 421: rc = 0 00100000:10000000:2.0:1788651211.064561:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 421: rc = 0 00100000:10000000:2.0:1788651211.064645:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 421: rc = 0 00100000:10000000:2.0:1788651211.065052:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 115: rc = 0 00100000:10000000:2.0:1788651211.065493:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 115: rc = 0 00100000:10000000:2.0:1788651211.066893:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 115: rc = 0 00100000:10000000:2.0:1788651211.067663:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 115: rc = 0 00100000:10000000:2.0:1788651211.067943:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 115: rc = 0 00100000:10000000:2.0:1788651211.068410:0:15081:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 115: rc = 0 00000020:00000080:2.0:1788651211.069594:0:15081:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788651211.069611:0:15081:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788651211.069626:0:15081:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84a2fba88797834f 00000020:01000004:2.0:1788651211.069638:0:15081:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788651211.069666:0:15081:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788651211.069671:0:15081:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788651211.069678:0:15081:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788651211.069684:0:15081:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788651211.069701:0:15081:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93be7bba19c0) 00000020:00000080:2.0:1788651211.069713:0:15081:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788651211.075220:0:15081:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651211.075504:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788651211.075510:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788651211.076315:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788651211.076323:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788651211.076809:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788651211.076817:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788651211.081614:0:15081:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651211.081789:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788651211.081795:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788651211.083757:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788651211.083766:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788651211.098639:0:15081:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651211.098882:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788651211.098888:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788651211.100300:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788651211.100311:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788651211.101485:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788651211.101496:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788651211.103633:0:15081:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651211.103796:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788651211.103802:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788651211.104547:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788651211.104555:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788651211.156563:0:15081:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651211.156762:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788651211.156768:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788651211.160772:0:15081:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788651211.160796:0:15081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788651211.161710:0:15081:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788651211.161744:0:15081:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788651211.161752:0:15081:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788651211.177706:0:15081:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788651211.177754:0:15081:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788651211.177760:0:15081:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788651211.177762:0:15081:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788651211.177763:0:15081:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651211.177765:0:15081:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651211.177771:0:15081:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651211.177773:0:15081:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651211.177774:0:15081:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788651211.177776:0:15081:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651211.177777:0:15081:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788651211.177782:0:15081:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788651211.177813:0:15081:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788651211.177814:0:15081:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788651211.177815:0:15081:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651211.177816:0:15081:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651211.177817:0:15081:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651211.177818:0:15081:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651211.177818:0:15081:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788651211.177819:0:15081:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651211.177820:0:15081:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788651211.177856:0:15081:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788651211.177884:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408304768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788651211.177975:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.178045:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be450adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.178102:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408304768 00000100:00100000:0.0:1788651211.178135:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408304768 00000100:00100000:0.0:1788651211.178346:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788651211.178359:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:15081:x1875536408304768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788651211.178401:0:14394:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788651211.178405:0:14394:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788651211.178410:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788651211.192063:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:15081:x1875536408304768:12345-0@lo:253:mount.lustre.0 Request processed in 13684us (14065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.192082:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651211.197999:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408304768:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788651211.198032:0:15081:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788651211.198036:0:15081:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788651211.198038:0:15081:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788651211.198040:0:15081:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651211.198041:0:15081:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651211.198042:0:15081:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651211.198044:0:15081:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651211.198046:0:15081:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788651211.198047:0:15081:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651211.198148:0:15081:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788651211.198939:0:15081:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93be7be43800 from lustre-OST0000 10000000:01000000:2.0:1788651211.198980:0:15081:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788651211.198984:0:15081:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788651211.198994:0:15081:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93be7bba0000 local copy 00010000:00010000:2.0:1788651211.199008:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651211.199352:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408304896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651211.199445:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.199498:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.199580:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408304896 00000100:00100000:0.0:1788651211.199588:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408304896 00000100:00100000:0.0:1788651211.199650:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788651211.199661:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:15081:x1875536408304896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651211.199932:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:15081:x1875536408304896:12345-0@lo:501:mount.lustre.0 Request processed in 272us (486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651211.199942:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651211.200080:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408304896:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788651211.200101:0:15081:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788651211.200315:0:15081:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788651211.200594:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.200607:0:15081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651211.200641:0:15081:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93be7be43800 10000000:01000000:2.0:1788651211.200648:0:15081:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788651211.200661:0:15081:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93be7bba0000 10000000:01000000:2.0:1788651211.200663:0:15081:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788651211.200667:0:15081:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93be7bba0000 from 1 10000000:01000000:2.0:1788651211.200670:0:15081:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788651211.200708:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.200717:0:15081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.200728:0:15081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651211.200748:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788651211.200789:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.200820:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.200911:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305024 00000100:00100000:0.0:1788651211.200918:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305024 00000100:00100000:0.0:1788651211.200962:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788651211.200971:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+12:15081:x1875536408305024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788651211.200984:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651211.200999:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be75860600/0x84a2fba887978364 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797835d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651211.201024:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be75860600/0x84a2fba887978364 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797835d expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651211.201035:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be75860600/0x84a2fba887978364 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797835d expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651211.201045:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860600, rc 0) 00000100:00100000:0.0:1788651211.201093:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+13:15081:x1875536408305024:12345-0@lo:101:mount.lustre.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.201099:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788651211.201804:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651211.201827:0:15081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978364 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.201839:0:15081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978364 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651211.201873:0:15081:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788651211.201892:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978364 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.201901:0:15081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618b000/0x84a2fba88797835d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978364 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651211.201909:0:15081:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788651211.201914:0:15081:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788651211.201921:0:15081:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788651211.201924:0:15081:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788651211.201953:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.201960:0:15081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.201968:0:15081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651211.201986:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788651211.202026:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.202067:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be450adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651211.202186:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305152 00000100:00100000:1.0:1788651211.202193:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305152 00000100:00100000:1.0:1788651211.202237:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788651211.202245:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+13:15081:x1875536408305152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788651211.202258:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651211.202278:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9d200/0x84a2fba887978372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797836b expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.202297:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9d200/0x84a2fba887978372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797836b expref: 14 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.202306:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9d200/0x84a2fba887978372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797836b expref: 14 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.202313:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d200, rc 0) 00000100:00100000:1.0:1788651211.202356:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305152:12345-0@lo:101:mount.lustre.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651211.202361:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788651211.202449:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651211.202460:0:15081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978372 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.202471:0:15081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978372 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651211.203981:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788651211.205558:0:15081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651211.206857:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788651211.206933:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788651211.206967:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788651211.207032:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788651211.207073:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788651211.207598:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788651211.207731:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788651211.207742:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788651211.207876:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651211.207971:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.208029:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651211.208147:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305280 00000100:00100000:1.0:1788651211.208157:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305280 00000100:00100000:1.0:1788651211.208231:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651211.208247:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651211.208698:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305280:12345-0@lo:501:mount.lustre.0 Request processed in 455us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651211.208708:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788651211.210927:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651211.211018:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651211.211156:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.211209:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.211732:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305408 00000100:00100000:0.0:1788651211.211741:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305408 00000100:00100000:0.0:1788651211.211809:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788651211.211821:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651211.212314:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305408:12345-0@lo:503:mount.lustre.0 Request processed in 492us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.212335:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788651211.212596:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788651211.214815:0:15081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788651211.214944:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651211.215036:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.215382:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.218070:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305536 00000100:00100000:0.0:1788651211.218092:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305536 00000100:00100000:0.0:1788651211.218211:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788651211.218225:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651211.218857:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305536:12345-0@lo:502:mount.lustre.0 Request processed in 632us (3817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.218868:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788651211.219381:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788651211.219769:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788651211.219842:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788651211.219878:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788651211.219940:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788651211.219974:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788651211.220005:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788651211.220059:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788651211.220093:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788651211.220191:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788651211.220237:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788651211.220281:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788651211.220331:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788651211.220392:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788651211.220472:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.220519:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be450ad540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651211.220731:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305664 00000100:00100000:2.0:1788651211.220739:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305664 00000100:00100000:2.0:1788651211.220791:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651211.220801:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651211.221031:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305664:12345-0@lo:502:mount.lustre.0 Request processed in 231us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651211.221038:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788651211.221315:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788651211.221418:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788651211.221496:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788651211.224935:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788651211.224952:0:15096:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788651211.224960:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.224963:0:15096:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788651211.224970:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651211.224993:0:15096:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93be81de0000) 00000020:00000080:0.0:1788651211.225023:0:15096:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788651211.225029:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788651211.225202:0:15096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7be43800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788651211.225212:0:15096:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788651211.225221:0:15096:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84a2fba887978380 00010000:00010000:0.0:1788651211.236840:0:15096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788651211.238791:0:15096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788651211.243550:0:15096:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788651211.248517:0:15096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788651211.248536:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651211.248546:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651211.248549:0:15096:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788651211.248554:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788651211.248558:0:15096:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788651211.248560:0:15096:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788651211.248561:0:15096:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788651211.248562:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788651211.248823:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651211.248826:0:15096:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788651211.248831:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651211.248834:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651211.248836:0:15096:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788651211.248839:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788651211.248842:0:15096:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788651211.248844:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651211.248847:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651211.248848:0:15096:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788651211.248851:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651211.248853:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651211.248854:0:15096:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788651211.248877:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788651211.248965:0:15096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651211.248969:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651211.248971:0:15096:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788651211.248974:0:15096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788651211.250948:0:15081:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788651211.250996:0:15081:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788651211.251037:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978372 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.251053:0:15081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56c000/0x84a2fba88797836b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978372 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651211.251064:0:15081:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7be43800 from 1 10000000:01000000:3.0:1788651211.251067:0:15081:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651211.251141:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.251150:0:15081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.251177:0:15081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651211.251211:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788651211.251312:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.251357:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be450ad540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651211.254402:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305792 00000100:00100000:2.0:1788651211.254421:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305792 00000100:00100000:2.0:1788651211.254496:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788651211.254509:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+14:15081:x1875536408305792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651211.254531:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651211.254555:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887978387 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.254591:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887978387 expref: 15 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.254604:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978387 expref: 15 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.254614:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:2.0:1788651211.254710:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408305792:12345-0@lo:101:mount.lustre.0 Request processed in 204us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651211.254717:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788651211.254791:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651211.254815:0:15081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.254826:0:15081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651211.258147:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788651211.258876:0:15081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651211.259221:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788651211.259282:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788651211.259340:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788651211.259348:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788651211.259462:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651211.259552:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.259617:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.259744:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408305920 00000100:00100000:0.0:1788651211.259754:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408305920 00000100:00100000:0.0:1788651211.259811:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788651211.259822:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408305920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651211.260084:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408305920:12345-0@lo:501:mount.lustre.0 Request processed in 263us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.260103:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788651211.266435:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408305920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651211.266518:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651211.266618:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.266674:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.267178:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306048 00000100:00100000:0.0:1788651211.267187:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306048 00000100:00100000:0.0:1788651211.267269:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788651211.267281:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306048:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651211.267536:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306048:12345-0@lo:503:mount.lustre.0 Request processed in 256us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.267545:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788651211.267919:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788651211.268678:0:15081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788651211.268779:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651211.270290:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.270357:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.273073:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306176 00000100:00100000:0.0:1788651211.273094:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306176 00000100:00100000:0.0:1788651211.273183:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788651211.273197:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651211.273570:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306176:12345-0@lo:502:mount.lustre.0 Request processed in 374us (3285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.273579:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788651211.273926:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788651211.274477:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788651211.274878:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788651211.274949:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788651211.274985:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788651211.275031:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788651211.275990:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788651211.276245:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788651211.276297:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788651211.276368:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651211.276483:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.276545:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.277208:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306304 00000100:00100000:0.0:1788651211.277219:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306304 00000100:00100000:0.0:1788651211.277295:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788651211.277308:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651211.277611:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306304:12345-0@lo:502:mount.lustre.0 Request processed in 305us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.277620:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788651211.277916:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788651211.278473:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788651211.278493:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788651211.283592:0:15100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651211.283610:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.283613:0:15100:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788651211.283621:0:15100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be7be43800 00000020:00000080:0.0:1788651211.283637:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788651211.283647:0:15100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651211.283650:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.283651:0:15100:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788651211.283654:0:15100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651211.283656:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.283658:0:15100:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788651211.283660:0:15100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93be7be43800 00000020:00000080:0.0:1788651211.283662:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788651211.283733:0:15100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651211.283736:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.283737:0:15100:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788651211.283739:0:15100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651211.283742:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.283743:0:15100:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788651211.283746:0:15100:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93be7be43800 00000020:00000080:0.0:1788651211.283747:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788651211.283779:0:15100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651211.283793:0:15100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651211.283795:0:15100:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788651211.283798:0:15100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788651211.284017:0:15081:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788651211.284052:0:15081:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651211.284078:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.284092:0:15081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651211.284164:0:15081:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788651211.284167:0:15081:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93be7be43800 10000000:01000000:2.0:1788651211.284171:0:15081:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93be7be43800 10000000:01000000:2.0:1788651211.284175:0:15081:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788651211.284181:0:15081:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93be7be43800 from 1 10000000:01000000:2.0:1788651211.284184:0:15081:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788651211.284230:0:15081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.284239:0:15081:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.284251:0:15081:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651211.284303:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788651211.284389:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.284439:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7586b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651211.284873:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306432 00000100:00100000:3.0:1788651211.284883:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306432 00000100:00100000:3.0:1788651211.286098:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788651211.286135:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408306432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651211.286157:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651211.286180:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56ce00/0x84a2fba88797839c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887978395 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.286215:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56ce00/0x84a2fba88797839c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887978395 expref: 16 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.286244:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56ce00/0x84a2fba88797839c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978395 expref: 16 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.286254:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ce00, rc 0) 00000100:00100000:3.0:1788651211.286368:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306432:12345-0@lo:101:mount.lustre.0 Request processed in 243us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651211.286376:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788651211.286532:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651211.286559:0:15081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797839c expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.286571:0:15081:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba88797839c expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651211.290572:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788651211.291045:0:15081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651211.291388:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788651211.291433:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788651211.291469:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788651211.291518:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788651211.291556:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788651211.291624:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788651211.291661:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788651211.291695:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788651211.291744:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788651211.291778:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788651211.291810:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788651211.291855:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788651211.291889:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788651211.291925:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788651211.291976:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788651211.292011:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788651211.292044:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788651211.292162:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788651211.292237:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788651211.299283:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788651211.299506:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788651211.299564:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788651211.299599:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788651211.299646:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788651211.299712:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788651211.299793:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788651211.299849:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788651211.299886:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788651211.300012:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788651211.300023:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788651211.300219:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788651211.300337:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.300405:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be450ad240 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.301104:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306560 00000100:00100000:0.0:1788651211.301144:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306560 00000100:00100000:0.0:1788651211.303358:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788651211.303384:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651211.303849:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306560:12345-0@lo:501:mount.lustre.0 Request processed in 475us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.303859:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788651211.307417:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788651211.307512:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788651211.307622:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.307679:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be450ad240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651211.310192:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306688 00000100:00100000:2.0:1788651211.310211:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306688 00000100:00100000:2.0:1788651211.310295:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788651211.310308:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651211.310660:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306688:12345-0@lo:503:mount.lustre.0 Request processed in 354us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651211.310671:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788651211.311234:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788651211.313080:0:15081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788651211.313225:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788651211.313318:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651211.313363:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be538a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651211.320486:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306816 00000100:00100000:2.0:1788651211.320509:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306816 00000100:00100000:2.0:1788651211.320596:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788651211.320610:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651211.321056:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306816:12345-0@lo:502:mount.lustre.0 Request processed in 449us (7736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651211.321066:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788651211.321464:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788651211.323225:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788651211.323363:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788651211.323404:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788651211.324433:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788651211.324524:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788651211.324632:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788651211.324764:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788651211.324806:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788651211.325035:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788651211.325539:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788651211.325588:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788651211.325779:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788651211.325839:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788651211.326001:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788651211.326069:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788651211.326345:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788651211.326458:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788651211.326579:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788651211.326626:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788651211.326671:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788651211.326817:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788651211.326866:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788651211.326898:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788651211.326966:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788651211.327019:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788651211.327058:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788651211.327153:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788651211.327270:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788651211.327327:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788651211.327375:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788651211.327411:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788651211.327444:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788651211.327483:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788651211.327580:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788651211.327634:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788651211.327705:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788651211.327843:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788651211.327882:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788651211.327930:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788651211.327969:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788651211.328040:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651211.328190:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.328255:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4449f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788651211.328475:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408306944 00000100:00100000:0.0:1788651211.328489:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408306944 00000100:00100000:0.0:1788651211.328550:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788651211.328563:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651211.329419:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408306944:12345-0@lo:502:mount.lustre.0 Request processed in 856us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651211.329431:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788651211.329481:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408306944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788651211.329636:0:15081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788651211.329651:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788651211.332763:0:15105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788651211.332786:0:15105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93be7bba3380) 00000020:00000080:2.0:1788651211.332815:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788651211.332946:0:15105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93be7be43800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788651211.332952:0:15105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93be7be43800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788651211.332955:0:15105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93be7be43800 3 00010000:00080000:2.0:1788651211.333003:0:15105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93be46385000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1788651211.337282:0:15105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788651211.338777:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788651211.338821:0:15105:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788651211.338835:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x84a2fba8879783aa 00000100:00080000:1.0:1788651211.338855:0:15105:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788651211.338862:0:15105:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93be46385000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1788651211.338897:0:15105:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be74f96680 x1875536408307072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788651211.338925:0:15105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788651211.339504:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875536408307072:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788651211.339570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.339647:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307072 00000100:00100000:2.0:1788651211.339663:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307072 00000100:00100000:2.0:1788651211.339722:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651211.339735:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875536408307072:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788651211.339781:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:2.0:1788651211.339852:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x84a2fba8879783b1 00000004:00100000:2.0:1788651211.339872:0:14403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788651211.339920:0:14403:0:(import.c:65:import_set_state_nolock()) ffff93be76599800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651211.340018:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875536408307072:12345-0@lo:38:llog_process_th.0 Request processed in 284us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651211.340029:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788651211.340068:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93be74f96680 x1875536408307072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651211.340081:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788651211.340091:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788651211.340099:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788651211.340103:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788651211.340142:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be46385000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788651211.340150:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875536408307072:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788651211.340445:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788651211.340451:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651211.340454:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788651211.340458:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788651211.340533:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408307200:0@lo:400:kworker.0 00000100:00100000:1.0:1788651211.340592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651211.340751:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307200 00000100:00100000:3.0:1788651211.340760:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307200 00000100:00100000:3.0:1788651211.340825:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651211.340835:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408307200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651211.341712:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408307200:12345-0@lo:400:kworker.0 Request processed in 875us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651211.341733:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:2.0:1788651211.342478:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:1.0:1788651211.342792:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93be75404a80 x1875536408307200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651211.342811:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408307200:0@lo:400:kworker.0 00000020:01000000:1.0:1788651211.343183:0:15081:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788651211.343217:0:15081:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788651211.343243:0:15081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797839c expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.343255:0:15081:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be4618a200/0x84a2fba887978395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797839c expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788651211.343755:0:15081:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788651211.343758:0:15081:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788651211.343759:0:15081:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651211.343760:0:15081:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651211.343761:0:15081:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651211.343763:0:15081:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651211.343764:0:15081:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788651211.343766:0:15081:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651211.343767:0:15081:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788651211.343772:0:15081:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788651211.343774:0:15081:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788651211.343776:0:15081:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788651211.343777:0:15081:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651211.343778:0:15081:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651211.343779:0:15081:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651211.343780:0:15081:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651211.343782:0:15081:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788651211.343783:0:15081:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651211.343784:0:15081:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788651211.343810:0:15081:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788651211.343830:0:15081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408307328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788651211.346575:0:15081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651211.347190:0:15081:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651211.347257:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307328 00000100:00100000:1.0:1788651211.347286:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307328 00000100:00100000:1.0:1788651211.347787:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788651211.347798:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15081:x1875536408307328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788651211.347831:0:14394:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788651211.348798:0:14394:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788651211.414200:0:14394:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788651211.414223:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788651211.414872:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788651211.414879:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788651211.414901:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.414930:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797831e expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.414939:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.414980:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797831e expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.414994:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797831e expref: 16 pid: 14395 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651211.415007:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875536408307456:0@lo:104: 00000100:00100000:2.0:1788651211.416347:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651211.416419:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be46067c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651211.416539:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307456 00000100:00100000:3.0:1788651211.416548:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307456 00000100:00100000:3.0:1788651211.416599:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651211.416611:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14417:x1875536408307456:12345-0@lo:104: 00010000:00010000:3.0:1788651211.416627:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651211.416716:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651211.416737:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14417:x1875536408307456:12345-0@lo:104: Request processed in 129us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651211.416744:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651211.416986:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875536408307456:0@lo:104: 00010000:00010000:2.0:1788651211.417009:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.417198:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651211.417206:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.417214:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9de00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651211.417219:0:14389:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.417227:0:14389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651211.417233:0:14389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651211.417239:0:14389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651211.417291:0:14389:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.417298:0:14389:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651211.417321:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.417381:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9de00/0x84a2fba88797831e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978325 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.417398:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651211.417400:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651211.417402:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651211.417642:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408307584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651211.417781:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651211.418224:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307584 00000100:00100000:1.0:1788651211.418231:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307584 00010000:00010000:1.0:1788651211.418256:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797831e expref: 17 pid: 14395 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651211.418303:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788651211.418312:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:3307:x1875536408307584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651211.418325:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651211.418331:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797831e expref: 17 pid: 14395 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418342:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797831e expref: 17 pid: 14395 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418359:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be6d56d200/0x84a2fba887978325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797831e expref: 17 pid: 14395 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418547:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418557:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788651211.418587:0:14388:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004827348s 00010000:00010000:1.0:1788651211.418592:0:14388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418600:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418607:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418613:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418619:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651211.418627:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.418635:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.422473:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651211.422490:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.426323:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.426344:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618b400/0x84a2fba8879783b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651211.426368:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651211.426499:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:3307:x1875536408307584:12345-0@lo:103:ldlm_bl.0 Request processed in 8185us (8715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651211.426509:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651211.426728:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408307584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651211.430660:0:15081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15081:1875536408307328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788651211.430679:0:15081:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788651211.430682:0:15081:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788651211.430684:0:15081:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788651211.430685:0:15081:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651211.430686:0:15081:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651211.430687:0:15081:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651211.430689:0:15081:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651211.430690:0:15081:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788651211.430692:0:15081:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651211.430693:0:15081:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788651211.430708:0:15081:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788651211.430834:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:15081:x1875536408307328:12345-0@lo:253:mount.lustre.0 Request processed in 82734us (83966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651211.430846:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00080000:10000000:2.0:1788651211.439205:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788651211.440495:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788651211.441029:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788651211.444186:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788651211.445802:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788651211.446795:0:15081:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788651211.451197:0:15081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788651211.461570:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788651211.523082:0:15081:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788651211.523091:0:15081:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788651211.523170:0:15081:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788651211.523233:0:15081:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788651211.523248:0:15081:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788651211.523286:0:15081:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:3.0:1788651211.781723:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788651212.485695:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788651213.324404:0:14398:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788651213.324411:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be7c1e4800 from 7 10000000:01000000:0.0:1788651213.324417:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788651213.324467:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651213.324479:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651213.324490:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651213.324517:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75406a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408307712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651213.324585:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651213.324655:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651213.324718:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307712 00000100:00100000:2.0:1788651213.324726:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307712 00000100:00100000:2.0:1788651213.324781:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788651213.324790:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+15:14398:x1875536408307712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651213.324802:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651213.324815:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879783bf expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651213.324837:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879783bf expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651213.324848:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879783bf expref: 16 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651213.324857:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a800, rc 0) 00000100:00100000:2.0:1788651213.324898:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:14398:x1875536408307712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651213.324911:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651213.329147:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75406a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408307712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651213.329178:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651213.329190:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651213.329281:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75406a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408307840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788651213.329341:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651213.329376:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651213.330175:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307840 00000100:00100000:2.0:1788651213.330184:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307840 00000100:00100000:2.0:1788651213.330302:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788651213.330312:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:14398:x1875536408307840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788651213.330333:0:14394:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788651213.330350:0:14394:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788651213.330354:0:14394:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788651213.330452:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:14398:x1875536408307840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651213.330458:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788651213.330735:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75406a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408307840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788651213.330799:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788651213.330808:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651213.330818:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651213.522921:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651214.533554:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651215.557142:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651216.580336:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788651216.772332:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788651216.772339:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788651216.772342:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788651216.772345:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788651216.772411:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408308096:0@lo:400:kworker.0 00000100:00100000:3.0:1788651216.772476:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651216.772532:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651216.772539:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408307968:0@lo:400:kworker.0 00000100:00100000:3.0:1788651216.772567:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651216.772598:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408308224:0@lo:400:kworker.0 00000100:00100000:3.0:1788651216.772641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651216.772689:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308096 00000100:00100000:3.0:1788651216.772696:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308096 00000100:00100000:1.0:1788651216.772730:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308224 00000100:00100000:1.0:1788651216.772736:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308224 00000100:00100000:3.0:1788651216.772757:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651216.772769:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408308096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651216.772773:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788651216.772782:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788651216.772823:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408308096:12345-0@lo:400:kworker.0 Request processed in 57us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651216.772832:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651216.772850:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651216.772857:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408308224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651216.772895:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408308224:12345-0@lo:400:kworker.0 Request processed in 39us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651216.772900:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651216.772923:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408307968 00000100:00100000:3.0:1788651216.772927:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408307968 00000100:00100000:3.0:1788651216.772957:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788651216.772964:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:3309:x1875536408307968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651216.772990:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:3309:x1875536408307968:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651216.772997:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788651216.773060:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be750ec000 x1875536408308224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651216.773074:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408308224:0@lo:400:kworker.0 00000100:00100000:3.0:1788651216.773101:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408307968:0@lo:400:kworker.0 00010000:00080000:3.0:1788651216.773136:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be750eed80 x1875536408308096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651216.773152:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408308096:0@lo:400:kworker.0 00000100:00080000:0.0:1788651216.773533:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788651217.521662:0:15449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788651217.606658:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651218.628283:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651219.653127:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651220.680477:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651221.700293:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788651221.893657:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788651221.893666:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651221.893669:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788651221.893672:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788651221.893796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408308352:0@lo:400:kworker.0 00000100:00100000:0.0:1788651221.893889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651221.893968:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408308608:0@lo:400:kworker.0 00000100:00100000:0.0:1788651221.894008:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651221.894030:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651221.894036:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408308480:0@lo:400:kworker.0 00000100:00100000:0.0:1788651221.894061:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651221.894096:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308608 00000100:00100000:0.0:1788651221.894133:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308608 00000100:00100000:0.0:1788651221.894207:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308480 00000100:00100000:0.0:1788651221.894211:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308480 00000100:00100000:0.0:1788651221.894236:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788651221.894246:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408308608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651221.894306:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408308608:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651221.894313:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788651221.894331:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788651221.894337:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408308480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651221.894362:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875536408308480:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651221.894368:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788651221.894383:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788651221.894441:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be75405880 x1875536408308480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651221.894458:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875536408308480:0@lo:400:kworker.0 00010000:00080000:0.0:1788651221.894469:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be75407800 x1875536408308608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651221.894485:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408308608:0@lo:400:kworker.0 00000100:00100000:2.0:1788651221.896278:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308352 00000100:00100000:2.0:1788651221.896297:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308352 00000100:00100000:2.0:1788651221.896360:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788651221.896370:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:3307:x1875536408308352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651221.896464:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:3307:x1875536408308352:12345-0@lo:400:kworker.0 Request processed in 96us (2575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651221.896472:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788651221.896613:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408308352:0@lo:400:kworker.0 00000040:00080000:2.0:1788651222.020898:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788651222.726679:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651223.749280:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788651224.404978:0:15799:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788651224.404985:0:15799:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788651224.405293:0:15799:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93bd43073000 00000020:01000004:0.0:1788651224.405316:0:15799:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788651224.405333:0:15799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788651224.405484:0:15799:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93be81de19c0) 00000020:00000080:0.0:1788651224.405505:0:15799:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788651224.447639:0:15799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788651224.448200:0:15799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788651224.449548:0:15799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788651224.449889:0:15799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788651224.451852:0:15799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788651224.452691:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 519: rc = 0 00100000:10000000:0.0:1788651224.452876:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 519: rc = 0 00100000:10000000:0.0:1788651224.453056:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 519: rc = 0 00100000:10000000:2.0:1788651224.455068:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 898: rc = 0 00100000:10000000:2.0:1788651224.455625:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 898: rc = 0 00100000:10000000:2.0:1788651224.456061:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 898: rc = 0 00100000:10000000:2.0:1788651224.456496:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 898: rc = 0 00100000:10000000:2.0:1788651224.456859:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 898: rc = 0 00100000:10000000:2.0:1788651224.457512:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 898: rc = 0 00000020:00000080:2.0:1788651224.470894:0:15799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788651224.470912:0:15799:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788651224.470930:0:15799:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84a2fba8879783d4 00000020:01000004:2.0:1788651224.470943:0:15799:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788651224.471552:0:15799:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788651224.471557:0:15799:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788651224.471565:0:15799:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788651224.471601:0:15799:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788651224.471607:0:15799:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788651224.503689:0:15799:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788651224.504092:0:15799:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.121@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788651224.504097:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788651224.504099:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788651224.504100:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651224.504102:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651224.504103:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651224.504104:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651224.504427:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788651224.504431:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651224.504432:0:15799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788651224.504438:0:15799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788651224.504441:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788651224.504443:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788651224.504444:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651224.504445:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651224.504446:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651224.504447:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651224.504448:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788651224.504449:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651224.504450:0:15799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788651224.504496:0:15799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788651224.504529:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408308736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788651224.504653:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651224.504837:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308736 00000100:00100000:2.0:1788651224.504846:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308736 00000100:00100000:2.0:1788651224.504906:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651224.504918:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15799:x1875536408308736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788651224.504971:0:14394:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788651224.504976:0:14394:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788651224.504981:0:14394:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788651224.505061:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5970c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651224.530653:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15799:x1875536408308736:12345-0@lo:253:mount.lustre.0 Request processed in 25728us (25991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.530668:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651224.534260:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408308736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788651224.534280:0:15799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788651224.534283:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788651224.534284:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788651224.534286:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651224.534287:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651224.534288:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651224.534290:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651224.534291:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788651224.534293:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651224.534294:0:15799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788651224.539348:0:15799:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93bd43073000 from lustre-OST0001 10000000:01000000:0.0:1788651224.539391:0:15799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788651224.539395:0:15799:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788651224.539403:0:15799:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93be7bba0000 local copy 00010000:00010000:0.0:1788651224.539414:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651224.539912:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408308864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651224.540396:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.540463:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.542769:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308864 00000100:00100000:2.0:1788651224.542783:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308864 00000100:00100000:2.0:1788651224.542995:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788651224.543004:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15799:x1875536408308864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788651224.546184:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15799:x1875536408308864:12345-0@lo:501:mount.lustre.0 Request processed in 3163us (5771us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651224.546199:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788651224.546495:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75407800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408308864:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788651224.546520:0:15799:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788651224.546690:0:15799:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788651224.546700:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.546712:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be6d56c200/0x84a2fba887978245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba88797824c expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651224.546737:0:15799:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93bd43073000 10000000:01000000:1.0:1788651224.546742:0:15799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788651224.546747:0:15799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788651224.546749:0:15799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788651224.546753:0:15799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788651224.546762:0:15799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788651224.546793:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.546801:0:15799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.546811:0:15799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651224.546830:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408308992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788651224.546868:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.546945:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788651224.546987:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408308992 00000100:00100000:3.0:1788651224.546993:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408308992 00000100:00100000:3.0:1788651224.547128:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788651224.547259:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:15799:x1875536408308992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788651224.547272:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651224.547349:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56d800/0x84a2fba8879783e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879783db expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.547374:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56d800/0x84a2fba8879783e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879783db expref: 17 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.547385:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56d800/0x84a2fba8879783e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879783db expref: 17 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.547394:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d800, rc 0) 00000100:00100000:3.0:1788651224.547482:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408308992:12345-0@lo:101:mount.lustre.0 Request processed in 226us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.547488:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788651224.547550:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408308992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788651224.547565:0:15799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879783e2 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.547574:0:15799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba8879783e2 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651224.548425:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788651224.549513:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788651224.549743:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788651224.549786:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788651224.549820:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788651224.549871:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788651224.549910:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788651224.549944:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788651224.550021:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788651224.550030:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788651224.550158:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651224.550225:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.550267:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651224.550341:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309120 00000100:00100000:3.0:1788651224.550348:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309120 00000100:00100000:3.0:1788651224.550387:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651224.550396:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788651224.550722:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309120:12345-0@lo:501:mount.lustre.0 Request processed in 327us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.550730:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788651224.550887:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651224.550921:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788651224.550962:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.550986:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651224.551048:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309248 00000100:00100000:0.0:1788651224.551054:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309248 00000100:00100000:0.0:1788651224.551087:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788651224.551096:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788651224.551494:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309248:12345-0@lo:503:mount.lustre.0 Request processed in 397us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651224.551503:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788651224.551532:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788651224.552307:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788651224.552367:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651224.552412:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.552451:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651224.552482:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309376 00000100:00100000:3.0:1788651224.552489:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309376 00000100:00100000:3.0:1788651224.552528:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788651224.552536:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93bd412b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788651224.552724:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93bd412b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309376:12345-0@lo:502:mount.lustre.0 Request processed in 188us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.552730:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788651224.552923:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788651224.553247:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788651224.553299:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788651224.553340:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788651224.553478:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788651224.553518:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788651224.553555:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788651224.553604:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788651224.553641:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788651224.553692:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788651224.553727:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788651224.553777:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.553815:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.553908:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309504 00000100:00100000:2.0:1788651224.553914:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309504 00000100:00100000:2.0:1788651224.553953:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788651224.553969:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93bd412b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651224.554145:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93bd412b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408309504:12345-0@lo:502:mount.lustre.0 Request processed in 184us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.554151:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788651224.554443:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408309504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788651224.554514:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788651224.554523:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788651224.556681:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788651224.556693:0:15800:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788651224.556702:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.556704:0:15800:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788651224.556710:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788651224.556735:0:15800:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93be58bf99c0) 00000020:00000080:1.0:1788651224.556757:0:15800:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788651224.556764:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788651224.556839:0:15800:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93bd43073000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788651224.556848:0:15800:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788651224.556856:0:15800:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84a2fba8879783f0 00010000:00010000:1.0:1788651224.564549:0:15800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788651224.564973:0:15800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788651224.574065:0:15800:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000100:00100000:1.0:1788651224.580259:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651209/real 1788651209] req@ffff93be75405500 x1875536408304384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651224.580296:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93be75405500 x1875536408304384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651224.580306:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651209/real 1788651209] req@ffff93be75405c00 x1875536408304512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651224.580318:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93be75405c00 x1875536408304512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788651224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788651224.580335:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be5b6a7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788651224.580354:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788651224.580358:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408304384:0@lo:8:kworker.0 00000100:00080000:1.0:1788651224.580363:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788651224.580368:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788651224.580371:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408304512:0@lo:8:kworker.0 00000100:00080000:3.0:1788651224.580717:0:13952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788651224.580723:0:13952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788651224.580726:0:13952:0:(import.c:65:import_set_state_nolock()) ffff93be5b6a7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788651224.580731:0:13952:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1788651224.580736:0:13952:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788651224.580742:0:13952:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93be5b6a7800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1788651224.580779:0:13952:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be750eea00 x1875536408309632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788651224.580799:0:13952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788651224.580803:0:13952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788651224.580804:0:13952:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788651224.580808:0:13952:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:3.0:1788651224.580810:0:13952:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788651224.580814:0:13952:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93be456b5800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1788651224.580826:0:13952:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be750ec000 x1875536408309760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651224.580879:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408309888:0@lo:400:kworker.0 00000100:00100000:0.0:1788651224.580941:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.581040:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408309632:0@lo:8:kworker.0 00000100:00100000:1.0:1788651224.581075:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.581135:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408309760:0@lo:8:kworker.0 00000100:00100000:1.0:1788651224.581165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.581265:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651224.581272:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408310016:0@lo:400:kworker.0 00000100:00100000:0.0:1788651224.581299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.581327:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309888 00000100:00100000:0.0:1788651224.581333:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309888 00000100:00100000:0.0:1788651224.581372:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310016 00000100:00100000:0.0:1788651224.581375:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310016 00000100:00100000:0.0:1788651224.581406:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788651224.581413:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408309888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651224.581461:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408309888:12345-0@lo:400:kworker.0 Request processed in 48us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651224.581476:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788651224.581493:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788651224.581499:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408310016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651224.581527:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875536408310016:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651224.581534:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788651224.581553:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788651224.581580:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be750ee300 x1875536408310016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651224.581593:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875536408310016:0@lo:400:kworker.0 00010000:00080000:0.0:1788651224.581605:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be750ee680 x1875536408309888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651224.581614:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408309888:0@lo:400:kworker.0 00000100:00100000:3.0:1788651224.581933:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309632 00000100:00100000:3.0:1788651224.581939:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309632 00000100:00100000:3.0:1788651224.582025:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408309760 00000100:00100000:3.0:1788651224.582035:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408309760 00000100:00100000:1.0:1788651224.582205:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651224.582214:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875536408309632:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788651224.582240:0:15085:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:1.0:1788651224.582286:0:15085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba8879783f7 00002000:00100000:1.0:1788651224.582301:0:15085:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93be752e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788651224.582305:0:15085:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788651224.582308:0:15085:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788651224.588789:0:15085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788651224.588827:0:15085:0:(import.c:65:import_set_state_nolock()) ffff93be752e3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651224.588930:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875536408309632:12345-0@lo:8:kworker.0 Request processed in 6714us (7852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651224.588940:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651224.588975:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651224.588981:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875536408309760:12345-0@lo:8:kworker.0 00010000:02000000:1.0:1788651224.588997:0:15085:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (not set up) 00010000:00080000:2.0:1788651224.589080:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be750eea00 x1875536408309632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651224.589090:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788651224.589098:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788651224.589124:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788651224.589130:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788651224.589133:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be5b6a7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788651224.589147:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788651224.589152:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408309632:0@lo:8:kworker.0 00000004:00080000:2.0:1788651224.589189:0:14423:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788651224.589242:0:14424:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788651224.589260:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875536408310272:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788651224.589299:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.589320:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651224.589330:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651224.589339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408310144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651224.589364:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788651224.589444:0:14423:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428649335988ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788651224.589481:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788651224.589488:0:15084:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788651224.589611:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310272 00000100:00100000:2.0:1788651224.589628:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310272 00000100:00080000:2.0:1788651224.589666:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651224.589725:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651224.589733:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14424:x1875536408310272:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788651224.591193:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310144 00000100:00100000:0.0:1788651224.591203:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310144 00000100:00100000:0.0:1788651224.591254:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651224.591262:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875536408310144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651224.591300:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651224.591372:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875536408310144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651224.591379:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788651224.591430:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be75405180 x1875536408310144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651224.591450:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408310144:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788651224.595146:0:15803:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788651224.595156:0:15803:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788651224.595161:0:15803:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:1.0:1788651224.607470:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875536408309760:12345-0@lo:8:kworker.0 Request processed in 18479us (26296us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788651224.607489:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788651224.607548:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788651224.607554:0:3305:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788651224.607558:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408309760:0@lo:8:kworker.0 00002000:00010000:2.0:1788651224.613875:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.613887:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.613904:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.613909:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.613915:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.613933:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.613942:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.613949:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.613965:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651224.614439:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.614446:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.614454:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.614459:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.614467:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.614484:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.614491:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba8879783fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.614508:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.614510:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.614511:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.614937:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.614943:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.614951:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.614963:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.614967:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.614976:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.614983:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.614989:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.615053:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00000080:1.0:1788651224.615419:0:15800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788651224.615431:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651224.615437:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.615439:0:15800:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788651224.615442:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651224.615446:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.615447:0:15800:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788651224.615457:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788651224.615458:0:15800:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788651224.615460:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651224.615462:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.615463:0:15800:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788651224.615465:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651224.615467:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.615468:0:15800:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788651224.615471:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788651224.615511:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651224.615514:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.615515:0:15800:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788651224.615518:0:15800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788651224.615619:0:15799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788651224.615640:0:15799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788651224.615653:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879783e2 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.615662:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ca00/0x84a2fba8879783db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba8879783e2 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651224.615669:0:15799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93bd43073000 from 1 10000000:01000000:1.0:1788651224.615672:0:15799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651224.615700:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.615707:0:15799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.615716:0:15799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651224.615739:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788651224.615807:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.615846:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310400 00000100:00100000:1.0:1788651224.615853:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310400 00000100:00100000:1.0:1788651224.615895:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788651224.615904:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93bd412b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:15799:x1875536408310400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788651224.615917:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651224.615929:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797840c expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.615950:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797840c expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.615960:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797840c expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.615967:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d400, rc 0) 00000100:00100000:1.0:1788651224.615997:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93bd412b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310400:12345-0@lo:101:mount.lustre.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651224.616004:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788651224.616040:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788651224.616059:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788651224.616071:0:15799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.616079:0:15799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651224.616509:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788651224.616908:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788651224.617164:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788651224.617219:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788651224.617280:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788651224.617288:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788651224.617343:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651224.617387:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.617414:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42f8b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.618581:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310528 00000100:00100000:2.0:1788651224.618591:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310528 00000100:00100000:2.0:1788651224.618718:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788651224.618728:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93bd412b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310528:12345-0@lo:501:mount.lustre.0 00010000:00010000:0.0:1788651224.621221:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651224.621234:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.621247:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651224.621252:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.621262:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.621285:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.621292:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651224.622723:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93bd412b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310528:12345-0@lo:501:mount.lustre.0 Request processed in 3990us (5328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.622735:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788651224.622810:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788651224.622870:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651224.622914:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651224.622942:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310656 00000100:00100000:2.0:1788651224.622948:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310656 00000100:00100000:2.0:1788651224.623002:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788651224.623023:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93bd412b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651224.623197:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93bd412b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310656:12345-0@lo:503:mount.lustre.0 Request processed in 187us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.623204:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788651224.623242:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be42be9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.623255:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788651224.623856:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788651224.623927:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651224.623971:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651224.624001:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310784 00000100:00100000:2.0:1788651224.624006:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310784 00000100:00100000:2.0:1788651224.624032:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788651224.624039:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93bd412b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651224.624222:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93bd412b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310784:12345-0@lo:502:mount.lustre.0 Request processed in 183us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.624230:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00010000:2.0:1788651224.625072:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.625081:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625096:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.625100:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.625123:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625153:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625164:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625184:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625205:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.625217:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.625222:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625230:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.625234:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625243:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625258:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625266:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba88797841a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.625290:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.625292:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.625294:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651224.627145:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651224.627150:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651224.627153:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.627833:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.627843:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627858:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.627861:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.627867:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627879:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627888:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627895:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627911:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.627921:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.627926:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627944:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.627948:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627957:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627972:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627980:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978421 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.627995:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.627997:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.627999:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651224.628023:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.628059:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788651224.628902:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788651224.628967:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788651224.629018:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788651224.629054:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788651224.629087:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788651224.629158:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788651224.629204:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788651224.629233:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788651224.629289:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651224.629715:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651224.629760:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408310912 00000100:00100000:2.0:1788651224.629768:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408310912 00000100:00100000:2.0:1788651224.629810:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788651224.629819:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788651224.630012:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408310912:12345-0@lo:502:mount.lustre.0 Request processed in 193us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.630020:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00010000:2.0:1788651224.631253:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.631264:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.631280:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.631285:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.631291:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.631305:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.631316:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.631323:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.631934:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788651224.632183:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be441afcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.632219:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408310912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788651224.632332:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00010000:00010000:0.0:1788651224.632736:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651224.632743:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.632759:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651224.632764:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.632775:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.632792:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.632801:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba887978428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.632818:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651224.632819:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651224.632821:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651224.633444:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788651224.639719:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651224.639732:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.639735:0:15806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788651224.639742:0:15806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93bd43073000 00000020:00000080:1.0:1788651224.639745:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788651224.639752:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651224.639754:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.639756:0:15806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788651224.639758:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651224.639760:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.639762:0:15806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788651224.639765:0:15806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93bd43073000 00000020:00000080:1.0:1788651224.639767:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788651224.639825:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651224.639828:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.639829:0:15806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788651224.639832:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651224.639834:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.639835:0:15806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788651224.639839:0:15806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93bd43073000 00000020:00000080:1.0:1788651224.639841:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788651224.639883:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651224.639887:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651224.639888:0:15806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788651224.639891:0:15806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00002000:00010000:2.0:1788651224.640197:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.640206:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640224:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.640229:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.640235:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640249:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640259:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640267:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640284:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.640295:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.640306:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640314:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.640319:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640328:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640411:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640420:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba88797842f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640435:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.640436:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.640438:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.640903:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.640909:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640918:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.640921:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.640925:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640945:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640954:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640961:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.640978:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788651224.641606:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.641613:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641694:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.641698:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.641702:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641712:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641721:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641740:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641758:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788651224.641771:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788651224.641776:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641783:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.641788:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641796:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641808:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.641815:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978436 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.642472:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.642478:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.642497:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.642501:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.642509:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.642521:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.642529:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797843d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1788651224.646593:0:15799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788651224.647079:0:15799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651224.647094:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.647139:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651224.647320:0:15799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788651224.647323:0:15799:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93bd43073000 10000000:01000000:0.0:1788651224.647333:0:15799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93bd43073000 10000000:01000000:0.0:1788651224.647579:0:15799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788651224.649754:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.653036:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.653043:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.653045:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788651224.655160:0:15799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93bd43073000 from 1 10000000:01000000:0.0:1788651224.655168:0:15799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788651224.655217:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.655228:0:15799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.655238:0:15799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651224.655262:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788651224.655323:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1788651224.656096:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.656120:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656137:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.656141:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.656148:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656162:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651224.656162:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311040 00000100:00100000:1.0:1788651224.656179:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311040 00010000:00010000:2.0:1788651224.656188:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656195:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656212:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651224.656222:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788651224.656231:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408311040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788651224.656232:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.656237:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.656243:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651224.656244:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.656248:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.656255:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9c800/0x84a2fba887978452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba887978444 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656257:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656272:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.656276:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9c800/0x84a2fba887978452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba887978444 expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.656281:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba88797844b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.656286:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9c800/0x84a2fba887978452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978444 expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.656292:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c800, rc 0) 00010000:00010000:2.0:1788651224.656297:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.656304:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.656305:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651224.657006:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311040:12345-0@lo:101:mount.lustre.0 Request processed in 774us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651224.657014:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00002000:00010000:2.0:1788651224.657900:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.657908:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.657919:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.657923:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.657929:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.657942:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.657951:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.657959:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.657975:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.657985:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.657990:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.657998:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.658001:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658022:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658035:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658043:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f4007a/0x84a2fba887978459 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658058:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.658060:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.658061:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.658524:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.658530:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658538:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.658541:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.658545:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658554:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658561:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658575:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658597:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651224.658939:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651224.658947:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.658955:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ba00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651224.658959:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651224.658969:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.658975:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.658975:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658984:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.658987:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651224.658990:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.658991:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.658999:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389c4d15/0x84a2fba887978460 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.659001:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.659009:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.659016:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.659016:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651224.659017:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651224.659019:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.659030:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788651224.661586:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e540 going to sleep for 11 seconds 00010000:00010000:2.0:1788651224.661704:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.661713:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.661732:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.661736:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.661747:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.661764:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.661772:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba887978467 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.661793:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.661795:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.661797:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651224.662029:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788651224.662052:0:15799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978452 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651224.662061:0:15799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978452 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651224.664604:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.664682:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664700:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.664704:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.664710:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664858:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664876:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664885:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664912:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.664925:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.664930:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664935:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.664938:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664944:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664955:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664959:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba88797846e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.664972:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.664978:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.664979:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.665729:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.665737:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665747:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.665751:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.665756:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665765:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665774:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665781:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665795:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.665804:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.665808:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665815:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618a400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.665818:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665837:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665850:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665857:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978475 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.665871:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.665873:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.665874:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.666448:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.666455:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666465:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.666468:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.666472:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666481:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666490:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666504:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666519:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.666529:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.666533:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666540:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ae00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.666544:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666552:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666564:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666571:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930ba223/0x84a2fba88797847c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.666584:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.666585:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.666587:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.667411:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.667426:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667436:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.667440:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.667444:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667454:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667462:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667468:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667483:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.667492:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.667497:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667504:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06e00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.667508:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667515:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667534:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667541:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bad74e5/0x84a2fba887978483 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.667555:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.667557:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.667558:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.668080:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.668087:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668096:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.668099:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.668104:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668134:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668143:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668149:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668184:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.668194:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.668198:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668205:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.668209:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668217:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668229:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668237:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba88797848a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.668250:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.668251:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.668253:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.669571:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.669580:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.669591:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.669599:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.669605:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.669683:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.669694:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.669701:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.669722:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651224.669736:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.669743:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.669761:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.669765:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.669772:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.669785:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.669791:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea7d815d/0x84a2fba887978491 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.669808:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.669810:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.669811:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651224.670301:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.670308:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.670318:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.670321:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.670325:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.670334:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.670422:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.670436:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.670588:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788651224.671325:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.671333:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.671438:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.671445:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.671454:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.671458:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.671466:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.671489:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.671497:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2eb8b36/0x84a2fba887978498 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.671512:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.671514:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.671516:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.671550:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.671554:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.671559:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.671568:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.671576:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.671583:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.671697:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788651224.672099:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.672120:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.672133:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.672135:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.672139:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.672148:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.672155:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.672161:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672308:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651224.672314:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672322:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.672325:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672332:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672408:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672415:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000557874fe/0x84a2fba88797849f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672441:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.672444:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672450:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07c00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.672453:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672461:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672471:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672478:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.672480:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.672481:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.672514:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788651224.672519:0:15803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.672693:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788651224.672925:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788651224.673101:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000040:00080000:0.0:1788651224.673205:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00010000:2.0:1788651224.673424:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.673435:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.673438:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.673444:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.673465:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.673473:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.673480:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.673498:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651224.673689:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.673695:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.673702:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.673705:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.673724:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.673736:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.673742:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aa63283/0x84a2fba8879784ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.673756:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.673758:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.673760:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651224.673783:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651224.674100:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788651224.674219:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788651224.674253:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788651224.674298:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00002000:00010000:2.0:1788651224.674331:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000040:00080000:0.0:1788651224.674341:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788651224.674390:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788651224.674610:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788651224.674662:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00010000:00010000:2.0:1788651224.674687:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674701:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.674704:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.674710:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651224.674711:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00010000:00010000:2.0:1788651224.674721:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674731:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651224.674744:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00010000:00010000:2.0:1788651224.674750:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674769:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788651224.674775:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00010000:00010000:2.0:1788651224.674782:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.674787:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674795:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06c00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.674798:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674807:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651224.674819:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00010000:00010000:2.0:1788651224.674820:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674828:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.674844:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.674846:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.674848:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651224.674933:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788651224.674969:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788651224.675019:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788651224.675059:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788651224.675091:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788651224.675238:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788651224.675276:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788651224.675308:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788651224.675351:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788651224.675386:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788651224.675419:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788651224.675494:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788651224.675528:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788651224.675559:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788651224.675600:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788651224.675633:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788651224.675664:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788651224.675716:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788651224.675750:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788651224.675776:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788651224.675802:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788651224.676025:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788651224.676063:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788651224.676134:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788651224.676179:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00002000:00010000:2.0:1788651224.676253:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.676267:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651224.676274:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00010000:00010000:2.0:1788651224.676279:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=428s v=(0 0) 00000040:00080000:0.0:1788651224.676280:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00010000:00010000:2.0:1788651224.676283:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.676288:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.676299:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.676308:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.676315:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651224.676369:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651224.676480:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.676526:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788651224.676528:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.676535:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.676543:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.676547:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.676555:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.676570:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.676586:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.676588:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.676589:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651224.676688:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311168 00000100:00100000:1.0:1788651224.676694:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311168 00000100:00100000:1.0:1788651224.676731:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651224.676737:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788651224.676916:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311168:12345-0@lo:501:mount.lustre.0 Request processed in 177us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651224.676924:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788651224.676956:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788651224.676986:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788651224.677022:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788651224.677030:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.677037:0:15803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac545a59/0x84a2fba8879784bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651224.677039:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651224.677066:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311296 00000100:00100000:2.0:1788651224.677070:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311296 00000100:00100000:2.0:1788651224.677098:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788651224.677132:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788651224.677284:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311296:12345-0@lo:503:mount.lustre.0 Request processed in 179us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.677298:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788651224.677471:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788651224.678564:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788651224.678652:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651224.678704:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.678736:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311424 00000100:00100000:0.0:1788651224.678741:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311424 00000100:00100000:0.0:1788651224.678772:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651224.678781:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651224.678974:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311424:12345-0@lo:502:mount.lustre.0 Request processed in 193us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651224.678981:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651224.679027:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651224.679044:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788651224.679384:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788651224.679428:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788651224.679462:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788651224.679519:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788651224.679554:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788651224.679600:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788651224.679637:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788651224.679670:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788651224.679717:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788651224.679754:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788651224.679788:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788651224.679835:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788651224.679872:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788651224.679905:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788651224.679968:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788651224.680006:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788651224.680037:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788651224.680083:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788651224.680139:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788651224.680183:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788651224.680229:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788651224.680262:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788651224.680294:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788651224.680351:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788651224.680385:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788651224.680416:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788651224.680460:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788651224.680495:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788651224.680525:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788651224.680565:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788651224.680611:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788651224.680645:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788651224.680678:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788651224.680724:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788651224.680758:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788651224.680803:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788651224.680846:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788651224.680879:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788651224.680940:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788651224.680976:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788651224.681018:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788651224.681081:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.681128:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060ecc0 going to sleep for 11 seconds 00002000:00010000:2.0:1788651224.681454:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.681463:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681478:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.681483:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.681489:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681502:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681513:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681521:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681538:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651224.681550:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651224.681556:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681564:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06a00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651224.681568:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681582:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681597:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681605:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9570b48/0x84a2fba8879784c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.681623:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.681625:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651224.681627:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651224.682194:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311552 00000100:00100000:1.0:1788651224.682203:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311552 00000100:00100000:1.0:1788651224.682258:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788651224.682269:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788651224.682505:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311552:12345-0@lo:502:mount.lustre.0 Request processed in 238us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651224.682522:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00002000:00010000:2.0:1788651224.683494:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.683502:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.683515:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.683519:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.683526:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.683537:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.683548:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.683565:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.683583:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651224.683785:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.683792:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.683800:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06c00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.683804:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.683813:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.683829:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.683980:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e170350/0x84a2fba8879784c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.683996:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.683999:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.684001:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651224.684152:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311552:0@lo:502:mount.lustre.0 00002000:00010000:2.0:1788651224.684188:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.684193:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684201:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.684204:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.684209:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684218:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684225:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684231:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684248:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788651224.684257:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788651224.684269:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00002000:00010000:2.0:1788651224.684792:0:15803:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651224.684798:0:15803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684812:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1788651224.684815:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651224.684819:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684828:0:15803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684837:0:15803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684844:0:15803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651224.684864:0:15803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788651224.685062:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651224.685068:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.685087:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07c00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.685091:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788651224.685094:0:15803:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:3.0:1788651224.685099:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651224.685194:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14424:x1875536408310272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 95460us (95892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651224.685203:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788651224.685240:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.685254:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85762c0/0x84a2fba8879784d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.685271:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.685274:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.685280:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.685284:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.685290:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.685300:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651224.685300:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875536408310272:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1788651224.685312:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e703044/0x84a2fba8879784d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651224.685314:0:14424:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00010000:00010000:3.0:1788651224.685325:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.685327:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.685329:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651224.685498:0:14424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75405f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875536408311680:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788651224.685537:0:14424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651224.685576:0:14424:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e900 going to sleep for 11 seconds 00010000:00010000:0.0:1788651224.685586:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788651224.685725:0:15811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788651224.685739:0:15811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93be81de3380) 00000020:00000080:0.0:1788651224.685757:0:15811:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000100:00100000:3.0:1788651224.685919:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311680 00000100:00100000:3.0:1788651224.685926:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311680 00000100:00100000:3.0:1788651224.685961:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651224.685970:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14424:x1875536408311680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788651224.686006:0:15084:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000020:01000004:0.0:1788651224.686936:0:15811:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93bd43073000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788651224.686942:0:15811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93bd43073000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788651224.686945:0:15811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93bd43073000 3 00010000:00080000:0.0:1788651224.686976:0:15811:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93bd41bba000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1788651224.690477:0:15811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788651224.690739:0:15811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788651224.690775:0:15811:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788651224.690787:0:15811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x84a2fba8879784e5 00000100:00080000:0.0:1788651224.690798:0:15811:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788651224.690810:0:15811:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93bd41bba000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1788651224.690846:0:15811:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be75404700 x1875536408311808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788651224.690879:0:15811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788651224.691455:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408311808:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788651224.691499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651224.691517:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14424:x1875536408311680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5548us (5979us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788651224.691527:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651224.691756:0:14424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75405f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14424:1875536408311680:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788651224.691770:0:14424:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1788651224.691791:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311808 00000100:00100000:0.0:1788651224.691795:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311808 00000100:00100000:0.0:1788651224.691863:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651224.691871:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875536408311808:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788651224.691892:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1788651224.691921:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x84a2fba8879784ec 00000004:00100000:0.0:1788651224.691936:0:14403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788651224.691975:0:14403:0:(import.c:65:import_set_state_nolock()) ffff93bd41bb8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651224.692024:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875536408311808:12345-0@lo:38:llog_process_th.0 Request processed in 152us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651224.692031:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788651224.692087:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93be75404700 x1875536408311808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651224.692096:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788651224.692102:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788651224.692132:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788651224.692136:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788651224.692138:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93bd41bba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788651224.692144:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875536408311808:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788651224.692298:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788651224.692474:0:15799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788651224.692503:0:15799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788651224.692550:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978452 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.692561:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be75860200/0x84a2fba887978444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978452 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788651224.692601:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788651224.692603:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788651224.692604:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651224.692605:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651224.692607:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651224.692608:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651224.692610:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788651224.692612:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651224.692613:0:15799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788651224.692627:0:15799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788651224.692629:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788651224.692631:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788651224.692632:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651224.692633:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651224.692634:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651224.692635:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651224.692637:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788651224.692638:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651224.692639:0:15799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788651224.692656:0:15799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788651224.692669:0:15799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311936:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788651224.692706:0:15799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.692735:0:15799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788651224.692826:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408311936 00000100:00100000:0.0:1788651224.692830:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408311936 00000100:00100000:0.0:1788651224.692894:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788651224.692902:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:15799:x1875536408311936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788651224.692920:0:14395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788651224.692933:0:14395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788651224.720888:0:14395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788651224.720904:0:14395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788651224.720935:0:14417:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788651224.720940:0:14417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788651224.721917:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.721939:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879783bf expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.721947:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.722040:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba8879783bf expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.722055:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba8879783bf expref: 19 pid: 14395 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651224.722069:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f96300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875536408312064:0@lo:104: 00000100:00100000:1.0:1788651224.722308:0:14417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.722370:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07240 going to sleep for 11 seconds 00000100:00100000:3.0:1788651224.722515:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312064 00000100:00100000:3.0:1788651224.722522:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312064 00000100:00100000:3.0:1788651224.722571:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651224.722594:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14417:x1875536408312064:12345-0@lo:104: 00010000:00010000:3.0:1788651224.722608:0:14385:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.722662:0:14385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651224.722668:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:14417:x1875536408312064:12345-0@lo:104: Request processed in 76us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.722675:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788651224.722696:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651224.722701:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.722709:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860800 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:3.0:1788651224.722713:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.722722:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651224.722729:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651224.722734:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788651224.722760:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.722767:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651224.722782:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.722800:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be75860800/0x84a2fba8879783bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba8879783c6 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.722817:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.722818:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651224.722820:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651224.722884:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408312192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651224.722917:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651224.723771:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f96300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14417:1875536408312064:0@lo:104: 00010000:00010000:1.0:1788651224.723812:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651224.724064:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312192 00000100:00100000:3.0:1788651224.724070:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312192 00010000:00010000:3.0:1788651224.724137:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879783bf expref: 20 pid: 14395 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651224.724161:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651224.724201:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+20:3309:x1875536408312192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651224.724213:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651224.724219:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba8879783bf expref: 20 pid: 14395 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724244:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba8879783bf expref: 20 pid: 14395 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724286:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618a800/0x84a2fba8879783c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba8879783bf expref: 20 pid: 14395 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724323:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724345:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788651224.724384:0:14387:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004827348s 00010000:00010000:3.0:1788651224.724389:0:14387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724396:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724403:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724410:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724415:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651224.724419:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724426:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724439:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651224.724453:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651224.724511:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408312192:12345-0@lo:103:ldlm_bl.0 Request processed in 313us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.724519:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788651224.724724:0:14417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.724733:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651224.724770:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9c000/0x84a2fba8879784f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651224.725354:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408312192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651224.731465:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:15799:x1875536408311936:12345-0@lo:253:mount.lustre.0 Request processed in 38557us (38751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651224.731479:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788651224.731580:0:15799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:15799:1875536408311936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788651224.731595:0:15799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788651224.731599:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788651224.731601:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788651224.731602:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788651224.731603:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788651224.731604:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788651224.731605:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788651224.731607:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788651224.731609:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788651224.731610:0:15799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788651224.731623:0:15799:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788651224.739337:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788651224.739505:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788651224.739684:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788651224.740058:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788651224.740250:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788651224.740457:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788651224.741646:0:15799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788651224.772290:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788651224.781507:0:15799:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788651224.781516:0:15799:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788651224.781555:0:15799:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788651224.781616:0:15799:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788651224.781632:0:15799:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788651224.781663:0:15799:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788651225.805040:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788651226.502743:0:14398:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788651226.502751:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93be7c1e4800 from 8 10000000:01000000:1.0:1788651226.502756:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788651226.502802:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651226.502814:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651226.502825:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651226.502851:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408312320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651226.502922:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651226.502990:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be44116600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651226.503043:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312320 00000100:00100000:0.0:1788651226.503052:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312320 00000100:00100000:1.0:1788651226.506142:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788651226.506169:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7584c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408312320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651226.506188:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651226.506207:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9de00/0x84a2fba887978501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba8879784fa expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651226.506235:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9de00/0x84a2fba887978501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba8879784fa expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651226.506246:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9de00/0x84a2fba887978501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba8879784fa expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651226.506256:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9de00, rc 0) 00000100:00100000:1.0:1788651226.506323:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7584c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408312320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (3400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651226.506329:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788651226.506440:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408312320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651226.506459:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978501 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651226.506469:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978501 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651226.506536:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408312448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788651226.506573:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651226.506598:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be5953f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788651226.506755:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312448 00000100:00100000:3.0:1788651226.506763:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312448 00000100:00100000:3.0:1788651226.506803:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788651226.506811:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408312448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788651226.506826:0:14395:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788651226.506843:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788651226.506846:0:14395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788651226.506930:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408312448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651226.506937:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788651226.507007:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408312448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788651226.507062:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788651226.507070:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978501 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651226.507079:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9d800/0x84a2fba8879784fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978501 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651226.820508:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788651227.110048:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788651227.110253:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1788651227.845285:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651228.868439:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651229.892241:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651230.084366:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408312576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651230.084430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651230.084650:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312576 00000100:00100000:0.0:1788651230.084657:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312576 00000100:00100000:0.0:1788651230.084712:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651230.084722:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408312576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651230.084751:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788651230.084784:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651230.084790:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408312576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651230.084796:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651230.084829:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788651230.084862:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408312576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788651230.085006:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788651230.085011:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788651230.085015:0:38:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788651230.085020:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1788651230.085025:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788651230.085030:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93be456b5800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1788651230.085053:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93be750ec380 x1875536408312832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788651230.085145:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408312704:0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.085186:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.085222:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651230.085229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408313216:0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.085274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.085327:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408312832:0@lo:8:kworker.0 00000100:00100000:3.0:1788651230.085354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.085387:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408312960:0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.085409:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.085426:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651230.085431:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408313088:0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.085450:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.085478:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312704 00000100:00100000:3.0:1788651230.085482:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312704 00000100:00100000:3.0:1788651230.085518:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788651230.085525:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3307:x1875536408312704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651230.085563:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312832 00000100:00100000:3.0:1788651230.085565:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3307:x1875536408312704:12345-0@lo:400:kworker.0 Request processed in 41us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651230.085569:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312832 00000100:00100000:3.0:1788651230.085575:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788651230.085606:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788651230.085607:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313216 00000100:00100000:3.0:1788651230.085613:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313216 00000100:00100000:1.0:1788651230.085614:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875536408312832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788651230.085636:0:15085:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000100:00100000:3.0:1788651230.085649:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408312960 00000100:00100000:3.0:1788651230.085654:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408312960 00000020:00000080:1.0:1788651230.085666:0:15085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84a2fba887978508 00000100:00100000:3.0:1788651230.085668:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313088 00000100:00100000:3.0:1788651230.085672:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313088 00002000:00100000:1.0:1788651230.085680:0:15085:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93bd43313000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788651230.085686:0:15085:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1788651230.085688:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788651230.085698:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408313216:12345-0@lo:400:kworker.0 00002000:00100000:1.0:1788651230.085700:0:15085:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788651230.085735:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875536408313216:12345-0@lo:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651230.085741:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788651230.085753:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788651230.085768:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408312960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.085808:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875536408312960:12345-0@lo:400:kworker.0 Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651230.085814:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788651230.085829:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788651230.085836:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408313088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.085867:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875536408313088:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651230.085874:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788651230.085911:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651230.085941:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be750edc00 x1875536408313088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651230.085953:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875536408313088:0@lo:400:kworker.0 00010000:00080000:3.0:1788651230.085967:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be750ed500 x1875536408312960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651230.085976:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875536408312960:0@lo:400:kworker.0 00010000:00080000:3.0:1788651230.086005:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be750ece00 x1875536408313216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651230.086014:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875536408313216:0@lo:400:kworker.0 00000100:00100000:3.0:1788651230.086026:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408312704:0@lo:400:kworker.0 00002000:00080000:1.0:1788651230.086028:0:15085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788651230.086051:0:15085:0:(import.c:65:import_set_state_nolock()) ffff93bd43312000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651230.086124:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875536408312832:12345-0@lo:8:kworker.0 Request processed in 494us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651230.086130:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788651230.086544:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be750ec380 x1875536408312832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651230.086554:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788651230.086567:0:3305:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788651230.086574:0:3305:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788651230.086582:0:3305:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788651230.086585:0:3305:0:(import.c:65:import_set_state_nolock()) ffff93be456b5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788651230.086601:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788651230.086608:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875536408312832:0@lo:8:kworker.0 00000004:00080000:3.0:1788651230.086658:0:14426:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788651230.086675:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875536408313472:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788651230.086709:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.086731:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be43ee1840 going to sleep for 11 seconds 00000004:00080000:3.0:1788651230.086747:0:14425:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788651230.087163:0:14425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434147054638ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788651230.087192:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313472 00000100:00100000:3.0:1788651230.087197:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313472 00000100:00100000:3.0:1788651230.087243:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788651230.087252:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875536408313472:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788651230.087979:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651230.088036:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651230.088051:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408313344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651230.088099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651230.088231:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313344 00000100:00100000:3.0:1788651230.088236:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313344 00000100:00100000:3.0:1788651230.088266:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651230.088273:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875536408313344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651230.088296:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651230.088335:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875536408313344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651230.088353:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788651230.088403:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93be750ec380 x1875536408313344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651230.088421:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408313344:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788651230.112508:0:15083:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788651230.112521:0:15083:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788651230.112527:0:15083:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788651230.122323:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.122347:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.122366:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.122371:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.122378:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.122398:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.122409:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.122418:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.122608:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651230.122792:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651230.122800:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.122809:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651230.122814:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.122824:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.122853:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.122860:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050d0a2b5/0x84a2fba88797850f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.122878:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.122880:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.122882:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.123774:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.123783:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123795:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.123799:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.123805:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123816:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123826:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123835:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123852:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.123862:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.123867:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123875:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56cc00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.123878:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123897:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123909:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.123916:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bcc1630/0x84a2fba887978516 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.124171:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.124173:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.124175:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.124658:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.124665:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.124674:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.124677:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.124681:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.124691:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.125869:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.125888:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126065:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.126078:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.126083:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126092:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.126097:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126142:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126159:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126168:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d5a3cff/0x84a2fba88797851d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126190:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.126192:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.126194:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.126827:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.126840:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126851:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.126856:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.126862:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126874:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126883:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126891:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126906:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.126914:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.126918:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126926:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56ca00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.126930:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126937:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126954:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126961:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005280c3bb/0x84a2fba887978524 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.126976:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.126977:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.126979:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.127551:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.127558:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127568:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.127571:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.127577:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127587:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127596:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127604:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127628:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.127637:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.127641:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127648:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.127652:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127660:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127671:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127678:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd6504e/0x84a2fba88797852b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.127694:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.127696:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.127698:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.129232:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.129244:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129258:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.129269:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.129275:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129288:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129299:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129307:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129326:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.129456:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.129463:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129470:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.129475:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129483:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129498:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129518:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba887978532 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.129538:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.129539:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.129541:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.130993:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.131005:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131018:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.131022:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.131027:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131039:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131049:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131056:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131081:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651230.131158:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651230.131166:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.131176:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56de00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651230.131188:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.131198:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.131216:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.131225:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba887978539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.131246:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651230.131248:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651230.131250:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.131542:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.131552:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131560:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.131563:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.131566:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131575:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131583:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131595:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131609:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.131619:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.131622:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131629:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.131633:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131640:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131658:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131665:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba887978540 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.131680:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.131682:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.131683:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.132155:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.132162:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132171:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.132174:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.132179:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132188:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132197:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132204:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132231:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.132242:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.132247:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132254:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cce00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.132259:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132268:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132281:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132289:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978547 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132307:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.132309:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.132312:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.132807:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.132813:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132823:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.132832:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.132837:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132848:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132857:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132865:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132880:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.132890:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.132895:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132902:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.132906:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132915:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132926:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132946:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797854e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.132961:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.132963:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.132965:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.134035:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.134044:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.134055:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.134059:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.134064:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.134076:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.134084:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.134092:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.134168:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651230.134183:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651230.134191:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.134201:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651230.134206:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.134217:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.134232:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.134240:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba887978555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.134271:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.134275:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.134277:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.136221:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.136240:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136255:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.136260:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.136266:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136280:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136290:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136297:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136316:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.136328:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.136333:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136473:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cda00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.136478:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136487:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136508:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136515:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797855c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.136535:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.136537:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.136539:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.137246:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.137254:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.137265:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.137268:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.137273:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.137284:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.137292:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.137299:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.137325:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651230.137752:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651230.137761:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.137771:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cc400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651230.137776:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.137785:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.137871:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.137956:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013aa2160/0x84a2fba887978563 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.137978:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.137980:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.137982:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.139198:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.139208:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139222:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.139226:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.139231:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139244:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139253:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139260:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139278:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.139290:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.139294:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139302:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.139312:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139321:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139334:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139458:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdbb41b7/0x84a2fba88797856a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.139477:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.139479:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.139482:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.140308:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.140316:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140328:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.140332:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.140349:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140362:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140492:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140508:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140525:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.140536:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.140541:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140548:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cce00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.140553:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140561:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140573:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140580:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000563f2ed6/0x84a2fba887978571 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.140595:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.140596:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.140598:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.141497:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.141515:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141526:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.141530:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.141535:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141546:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141556:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141564:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141580:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.141590:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.141595:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141602:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.141606:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141615:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141637:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141646:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069efab96/0x84a2fba887978578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.141662:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.141664:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.141666:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.143036:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.143045:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143059:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.143063:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.143068:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143080:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143089:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143096:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143159:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.143172:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.143177:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143184:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cda00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.143188:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143197:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143210:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143218:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011ae2ac3/0x84a2fba88797857f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.143235:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.143237:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.143238:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.144089:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.144097:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144154:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.144164:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.144169:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144181:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144191:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144198:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144216:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.144228:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.144233:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144242:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821ccc00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.144247:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144256:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144268:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144288:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc1afc22/0x84a2fba887978586 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.144306:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.144308:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.144310:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.145234:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.145241:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.145252:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.145256:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.145261:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.145272:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.145281:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.145288:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.145433:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651230.145707:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651230.145724:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.145746:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651230.145750:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.145759:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.145773:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.145780:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006224b28b/0x84a2fba88797858d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.145798:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.145800:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.145802:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.146205:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.146219:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146229:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.146233:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.146238:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146249:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146258:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146265:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146281:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.146446:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.146452:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146460:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cc000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.146464:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146472:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146491:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146498:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebe80934/0x84a2fba887978594 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.146516:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.146519:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.146521:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.147594:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.147602:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.147612:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.147616:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.147622:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.147633:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.147643:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.147650:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.147681:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.147692:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.148000:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.148009:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cdc00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.148014:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.148023:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.148036:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.148044:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ceb915f/0x84a2fba88797859b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.148063:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.148065:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.148066:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.149545:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.149555:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.149568:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.149578:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.149586:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.149599:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.149610:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.149617:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.149644:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651230.149704:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651230.149774:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.149785:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be821cd800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651230.149790:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.149799:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.149816:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.149824:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9ffbd88/0x84a2fba8879785a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.149842:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651230.149844:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651230.149846:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788651230.152234:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788651230.153923:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.153948:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.153966:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.153971:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.153978:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.153993:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154004:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154018:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154040:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651230.154057:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651230.154064:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154072:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56de00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.154078:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154088:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154128:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154147:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da55ae47/0x84a2fba8879785a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154169:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.154171:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651230.154174:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788651230.154653:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.154668:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154679:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.154683:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.154688:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154698:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.154707:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.155058:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.155083:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788651230.155625:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788651230.155632:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.155642:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1788651230.155646:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651230.155651:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.155661:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.155678:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.155686:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651230.156030:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788651230.156840:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651230.156858:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.156870:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56c600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651230.156874:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.156885:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.156904:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.156911:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50815b0/0x84a2fba8879785b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.157093:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651230.157098:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.157104:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:3.0:1788651230.157636:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651230.157856:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651230.157864:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.157876:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788651230.157880:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651230.157886:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.157898:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.157907:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.157934:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.157958:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651230.158104:0:14389:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651230.158944:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.158958:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.159058:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.159067:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bcd0f06/0x84a2fba8879785b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651230.159088:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651230.159090:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651230.159093:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.159228:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.159237:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.159245:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07e00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651230.159248:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.159255:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.159273:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.159280:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4532f7f/0x84a2fba8879785be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.159295:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.159297:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.159298:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.159304:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.159305:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788651230.160329:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788651230.160339:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.160352:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1788651230.160357:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651230.160362:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.160374:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.160385:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.160391:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651230.160415:0:15083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651230.161069:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651230.161076:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.161086:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651230.161090:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.161100:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.161130:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.161148:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1976ef9/0x84a2fba8879785c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651230.161173:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.161175:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651230.161177:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788651230.161917:0:15083:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788651230.162173:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14426:x1875536408313472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 74919us (75458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651230.162190:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788651230.162309:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875536408313472:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788651230.162324:0:14426:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788651230.162372:0:14426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875536408313600:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788651230.162414:0:14426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651230.162464:0:14426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be8060e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651230.162509:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313600 00000100:00100000:2.0:1788651230.162516:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313600 00000100:00100000:2.0:1788651230.162558:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651230.162567:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14426:x1875536408313600:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788651230.162603:0:15803:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788651230.173611:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14426:x1875536408313600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11036us (11187us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788651230.173626:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788651230.173640:0:14426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75404700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14426:1875536408313600:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788651230.173658:0:14426:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:02000400:1.0:1788651230.442054:0:16160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788651230.916438:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651231.942099:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651232.265269:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788651232.614860:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.614967:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389446784 00000100:00100000:1.0:1788651232.614977:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389446784 00000100:00100000:1.0:1788651232.615031:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:1.0:1788651232.615039:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1875536389446784:12345-192.168.203.21@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788651232.615067:0:14396:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6ff11768-8c10-4a90-9fc6-27ef378342b1@192.168.203.21@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1788651232.615096:0:14396:0:(genops.c:1385:class_connect()) connect: client 6ff11768-8c10-4a90-9fc6-27ef378342b1, cookie 0x84a2fba8879785cc 00000100:00080000:1.0:1788651232.615272:0:14396:0:(import.c:65:import_set_state_nolock()) ffff93bd43314000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651232.615336:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+5:2352:x1875536389446784:12345-192.168.203.21@tcp:250:mount.lustre.0 Request processed in 295us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.615344:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 74 00000100:00100000:0.0:1788651232.629902:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.630554:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389446912 00000100:00100000:3.0:1788651232.630564:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389446912 00000100:00100000:3.0:1788651232.630674:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:3.0:1788651232.630686:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+5:13739:x1875536389446912:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788651232.630701:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651232.630718:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56de00/0x84a2fba8879785d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c406 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.630746:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56de00/0x84a2fba8879785d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c406 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.630757:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56de00/0x84a2fba8879785d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c406 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.630765:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56de00, rc 0) 00000100:00100000:3.0:1788651232.630840:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+6:13739:x1875536389446912:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 156us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.630847:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 75 00000100:00100000:0.0:1788651232.639031:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.642422:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447040 00000100:00100000:3.0:1788651232.642435:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447040 00000100:00100000:3.0:1788651232.642508:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:3.0:1788651232.642518:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+6:13739:x1875536389447040:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788651232.643352:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+6:13739:x1875536389447040:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 831us (4327us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651232.643364:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 76 00000100:00100000:0.0:1788651232.653153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.653267:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447168 00000100:00100000:3.0:1788651232.653276:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447168 00000100:00100000:3.0:1788651232.653326:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:3.0:1788651232.653336:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+6:13739:x1875536389447168:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788651232.653350:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651232.653367:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56d000/0x84a2fba8879785da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c40d expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.653395:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56d000/0x84a2fba8879785da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c40d expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.653407:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56d000/0x84a2fba8879785da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c40d expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.653416:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d000, rc 0) 00000100:00100000:3.0:1788651232.653473:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+7:13739:x1875536389447168:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 137us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.653497:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:0.0:1788651232.665436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.665528:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447296 00000100:00100000:3.0:1788651232.665537:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447296 00000100:00100000:3.0:1788651232.665630:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:3.0:1788651232.665642:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+7:13739:x1875536389447296:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788651232.665978:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13739:x1875536389447296:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 337us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.665986:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 78 00000100:00100000:0.0:1788651232.671207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.673204:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447424 00000100:00100000:1.0:1788651232.673217:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447424 00000100:00100000:1.0:1788651232.673413:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:1.0:1788651232.673739:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13739:x1875536389447424:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788651232.674729:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13739:x1875536389447424:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 1302us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.674739:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 79 00000100:00100000:1.0:1788651232.686221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.687293:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447552 00000100:00100000:3.0:1788651232.687313:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447552 00000100:00100000:3.0:1788651232.687412:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:3.0:1788651232.687423:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13758:x1875536389447552:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651232.688282:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13758:x1875536389447552:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 857us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.688292:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 80 00000100:00100000:0.0:1788651232.707676:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.708336:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447680 00000100:00100000:1.0:1788651232.708346:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447680 00000100:00100000:1.0:1788651232.708407:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:1.0:1788651232.708418:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13758:x1875536389447680:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651232.708907:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13758:x1875536389447680:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 488us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.708914:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:0.0:1788651232.729269:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.731615:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447808 00000100:00100000:3.0:1788651232.731630:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447808 00000100:00100000:3.0:1788651232.731824:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:3.0:1788651232.731836:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+8:13739:x1875536389447808:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788651232.731852:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651232.731870:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56ca00/0x84a2fba8879785e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c437 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.731899:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56ca00/0x84a2fba8879785e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c437 expref: 9 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.731942:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56ca00/0x84a2fba8879785e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c437 expref: 9 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651232.731951:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56ca00, rc 0) 00000100:00100000:3.0:1788651232.732020:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+9:13739:x1875536389447808:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 186us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.732027:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 82 00000100:00100000:3.0:1788651232.736290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651232.736414:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389447936 00000100:00100000:0.0:1788651232.736434:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389447936 00000100:00100000:0.0:1788651232.736498:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:0.0:1788651232.736508:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+9:13739:x1875536389447936:12345-192.168.203.21@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788651232.736547:0:14395:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788651232.736564:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788651232.736569:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788651232.736572:0:14395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788651232.736574:0:14395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788651232.738740:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+9:13739:x1875536389447936:12345-192.168.203.21@tcp:256:mount.lustre.0 Request processed in 2224us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.738754:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 83 00000100:00100000:1.0:1788651232.743933:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651232.745431:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448064 00000100:00100000:2.0:1788651232.745444:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448064 00000100:00100000:2.0:1788651232.745504:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:2.0:1788651232.745515:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+9:13739:x1875536389448064:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788651232.745530:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651232.745548:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c43e expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651232.745577:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651232.745588:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 10 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651232.745597:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07800, rc 0) 00000100:00100000:2.0:1788651232.745654:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13739:x1875536389448064:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 142us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651232.745661:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 84 00000100:00100000:3.0:1788651232.750365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.750490:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448192 00000100:00100000:1.0:1788651232.750499:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448192 00000100:00100000:1.0:1788651232.750584:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:1.0:1788651232.750596:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7b9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13739:x1875536389448192:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788651232.750942:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7b9b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13739:x1875536389448192:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 348us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.750949:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 85 00000100:00100000:0.0:1788651232.754271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651232.754335:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448320 00000100:00100000:2.0:1788651232.754346:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448320 00000100:00100000:2.0:1788651232.754405:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:2.0:1788651232.754430:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13739:x1875536389448320:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788651232.754857:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13739:x1875536389448320:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 427us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651232.754865:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 86 00000100:00100000:0.0:1788651232.764999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.765339:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448448 00000100:00100000:1.0:1788651232.765350:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448448 00000100:00100000:1.0:1788651232.765402:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:1.0:1788651232.765527:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13761:x1875536389448448:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651232.765802:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13761:x1875536389448448:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 376us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.765810:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 87 00000100:00100000:1.0:1788651232.774499:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651232.774655:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448576 00000100:00100000:2.0:1788651232.774665:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448576 00000100:00100000:2.0:1788651232.774719:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:2.0:1788651232.774730:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13761:x1875536389448576:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651232.775016:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13761:x1875536389448576:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 287us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651232.775024:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 88 00000100:00100000:0.0:1788651232.778406:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.778492:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448704 00000100:00100000:3.0:1788651232.778502:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448704 00000100:00100000:3.0:1788651232.778544:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1788651232.778550:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1875536389448704:12345-192.168.203.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788651232.778571:0:15393:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3263d5cc-8db6-4bb2-9e12-fc97a2814380@192.168.203.21@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1788651232.778616:0:15393:0:(genops.c:1385:class_connect()) connect: client 3263d5cc-8db6-4bb2-9e12-fc97a2814380, cookie 0x84a2fba8879785ef 00000004:00100000:3.0:1788651232.778646:0:15393:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788651232.778652:0:15393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788651232.823568:0:15393:0:(import.c:65:import_set_state_nolock()) ffff93bd43313800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651232.823690:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2352:x1875536389448704:12345-192.168.203.21@tcp:38:mount.lustre.0 Request processed in 45137us (45290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.823702:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1788651232.826252:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651232.826291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651232.826436:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448832 00000100:00100000:3.0:1788651232.826446:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448832 00000100:00100000:3.0:1788651232.826513:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389448960 00000100:00100000:3.0:1788651232.826516:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389448960 00000100:00100000:3.0:1788651232.826535:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1788651232.826545:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:0:x1875536389448832:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788651232.826586:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788651232.826662:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:0:x1875536389448832:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 118us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.826682:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1788651232.826699:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1788651232.826710:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13739:x1875536389448960:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788651232.826722:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788651232.826744:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13739:x1875536389448960:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 34us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.826750:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00080000:2.0:1788651232.827078:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651232.832788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.833259:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449088 00000100:00100000:1.0:1788651232.833269:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449088 00000100:00100000:1.0:1788651232.833330:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1788651232.833340:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13739:x1875536389449088:12345-192.168.203.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788651232.833585:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13739:x1875536389449088:12345-192.168.203.21@tcp:40:mount.lustre.0 Request processed in 245us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651232.833593:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1788651232.839360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651232.839391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651232.839430:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651232.839519:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449472 00000100:00100000:1.0:1788651232.839528:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449472 00000100:00100000:1.0:1788651232.839575:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1788651232.839585:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13739:x1875536389449472:12345-192.168.203.21@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788651232.840079:0:14404:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 430us 00000100:00100000:3.0:1788651232.840251:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449216 00000100:00100000:3.0:1788651232.840256:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449216 00000100:00100000:3.0:1788651232.840275:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449344 00000100:00100000:3.0:1788651232.840277:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449344 00000100:00100000:3.0:1788651232.840290:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1788651232.840296:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875536389449216:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788651232.840316:0:15084:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3263d5cc-8db6-4bb2-9e12-fc97a2814380@192.168.203.21@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1788651232.840348:0:15084:0:(genops.c:1385:class_connect()) connect: client 3263d5cc-8db6-4bb2-9e12-fc97a2814380, cookie 0x84a2fba8879785f6 00002000:00100000:3.0:1788651232.840358:0:15084:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3263d5cc-8db6-4bb2-9e12-fc97a2814380/ffff93bd419c2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788651232.840377:0:15084:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788651232.840695:0:15084:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788651232.840723:0:15084:0:(import.c:65:import_set_state_nolock()) ffff93bd419c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651232.840794:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2352:x1875536389449216:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 496us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.840802:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1788651232.840820:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1788651232.840832:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875536389449344:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788651232.840848:0:15084:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3263d5cc-8db6-4bb2-9e12-fc97a2814380@192.168.203.21@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1788651232.840863:0:15084:0:(genops.c:1385:class_connect()) connect: client 3263d5cc-8db6-4bb2-9e12-fc97a2814380, cookie 0x84a2fba8879785fd 00002000:00100000:3.0:1788651232.840868:0:15084:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3263d5cc-8db6-4bb2-9e12-fc97a2814380/ffff93bd419c3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788651232.840881:0:15084:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788651232.841017:0:15084:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788651232.841045:0:15084:0:(import.c:65:import_set_state_nolock()) ffff93bd419c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651232.841070:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2352:x1875536389449344:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 237us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651232.841088:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000004:00200000:0.0:1788651232.852027:0:14404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788651232.852169:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13739:x1875536389449472:12345-192.168.203.21@tcp:33:mount.lustre.0 Request processed in 12579us (12811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651232.852183:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00010000:00010000:0.0:1788651232.965202:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651233.062820:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651233.063032:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449600 00000100:00100000:3.0:1788651233.063041:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449600 00000100:00100000:3.0:1788651233.063295:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1788651233.063310:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13782:x1875536389449600:12345-192.168.203.21@tcp:101:mkdir.0 00010000:00010000:3.0:1788651233.063328:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651233.063352:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887978604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c468 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651233.063417:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797860b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651233.063431:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797860b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651233.063446:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797860b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651233.063500:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788651233.063504:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651233.063537:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797860b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651233.063560:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c400/0x84a2fba887978604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c468 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651233.063578:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797860b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c468 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651233.063587:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:3.0:1788651233.063590:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651233.063594:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c800, rc 0) 00000100:00100000:3.0:1788651233.063658:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:13782:x1875536389449600:12345-192.168.203.21@tcp:101:mkdir.0 Request processed in 352us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651233.064584:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:0.0:1788651233.988413:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651235.012330:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651235.059559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651235.059662:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449728 00000100:00100000:0.0:1788651235.059671:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449728 00000100:00080000:2.0:1788651235.059746:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651235.059808:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1788651235.059820:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:13835:x1875536389449728:12345-192.168.203.21@tcp:41:lfs.0 00000004:00000024:1.0:1788651235.059872:0:14402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788651235.059981:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:13835:x1875536389449728:12345-192.168.203.21@tcp:41:lfs.0 Request processed in 162us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651235.059988:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1788651235.068841:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.069984:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449856 00000100:00100000:3.0:1788651235.069995:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449856 00000100:00080000:2.0:1788651235.070137:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651235.070239:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1788651235.070251:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13835:x1875536389449856:12345-192.168.203.21@tcp:13:lfs.0 00002000:00000024:3.0:1788651235.070288:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651235.070374:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13835:x1875536389449856:12345-192.168.203.21@tcp:13:lfs.0 Request processed in 125us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.070382:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1788651235.074997:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651235.075140:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389449984 00000100:00100000:0.0:1788651235.075150:0:15087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389449984 00000100:00100000:0.0:1788651235.075214:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1788651235.075225:0:15087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13835:x1875536389449984:12345-192.168.203.21@tcp:13:lfs.0 00002000:00000024:0.0:1788651235.075278:0:15087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651235.075363:0:15087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:13835:x1875536389449984:12345-192.168.203.21@tcp:13:lfs.0 Request processed in 140us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.075371:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00080000:2.0:1788651235.075523:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651235.204633:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408313856:0@lo:400:kworker.0 00000100:00100000:3.0:1788651235.204722:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651235.204776:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408314368:0@lo:400:kworker.0 00000100:00100000:3.0:1788651235.204801:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651235.204827:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788651235.204834:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408313728:0@lo:400:kworker.0 00000100:00100000:3.0:1788651235.204862:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651235.204881:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408314240:0@lo:400:kworker.0 00000100:00100000:3.0:1788651235.204906:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651235.204932:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.205018:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408314112:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.205048:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651235.205070:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408314624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651235.205091:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651235.205135:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651235.205141:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408314496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651235.205164:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651235.205184:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651235.205206:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314368 00000100:00100000:0.0:1788651235.205214:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314368 00000100:00100000:3.0:1788651235.205226:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313856 00000100:00100000:3.0:1788651235.205231:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313856 00000100:00100000:0.0:1788651235.205265:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314240 00000100:00100000:0.0:1788651235.205270:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314240 00000100:00100000:3.0:1788651235.205273:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313984 00000100:00100000:3.0:1788651235.205279:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313984 00000100:00100000:0.0:1788651235.205291:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314112 00000100:00100000:0.0:1788651235.205296:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314112 00000100:00100000:3.0:1788651235.205312:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651235.205322:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408313856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651235.205371:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408313856:12345-0@lo:400:kworker.0 Request processed in 51us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.205378:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651235.205392:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651235.205399:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875536408313984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651235.205520:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408313728 00000100:00100000:1.0:1788651235.205525:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408313728 00000100:00100000:1.0:1788651235.205552:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788651235.205559:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408313728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651235.205594:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408313728:12345-0@lo:400:kworker.0 Request processed in 36us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651235.205600:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788651235.205624:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651235.205636:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788651235.205637:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408314368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651235.205648:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408314240:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788651235.206131:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651235.206135:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651235.206138:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651235.206193:0:15393:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788651235.206201:0:15393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788651235.206219:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314624 00000100:00100000:2.0:1788651235.206223:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314624 00000100:00100000:2.0:1788651235.206240:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314496 00000100:00100000:2.0:1788651235.206243:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314496 00000100:00100000:2.0:1788651235.206253:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651235.206259:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408314624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651235.206273:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651235.219577:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408314368:12345-0@lo:400:kworker.0 Request processed in 11027us (11857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.219594:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651235.223628:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651235.223646:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408314112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651235.224566:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1875536408313984:12345-0@lo:400:kworker.0 Request processed in 19162us (19379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.224577:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651235.229944:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408314112:12345-0@lo:400:kworker.0 Request processed in 6294us (24884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.229972:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651235.230041:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408314112:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.230219:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408314240:12345-0@lo:400:kworker.0 Request processed in 24574us (25311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.230227:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651235.231772:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.233778:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408313728:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.233816:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408314240:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.233829:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408313856:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.233845:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408314368:0@lo:400:kworker.0 00000100:00100000:0.0:1788651235.236425:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408314624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651235.236771:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408314624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30508us (31674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.236793:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788651235.236820:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788651235.236832:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875536408314496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651235.236853:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788651235.236908:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875536408314496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (31745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.236914:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651235.238280:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408314496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651235.281692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.285021:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450112 00000100:00100000:3.0:1788651235.285035:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450112 00000100:00100000:3.0:1788651235.285090:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:3.0:1788651235.285130:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+10:13864:x1875536389450112:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788651235.285146:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651235.285164:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56c400/0x84a2fba887978612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c46f expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.285191:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56c400/0x84a2fba887978612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c46f expref: 11 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.285202:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56c400/0x84a2fba887978612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c46f expref: 11 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.285212:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56c400, rc 0) 00000100:00100000:3.0:1788651235.285273:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13864:x1875536389450112:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 174us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.285280:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 90 00000100:00100000:1.0:1788651235.288918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651235.289567:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450240 00000100:00100000:2.0:1788651235.289578:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450240 00000100:00100000:2.0:1788651235.289636:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:2.0:1788651235.289647:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13864:x1875536389450240:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788651235.289894:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13864:x1875536389450240:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 241us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.289903:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 91 00000100:00100000:3.0:1788651235.293307:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651235.293618:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450368 00000100:00100000:2.0:1788651235.293629:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450368 00000100:00100000:2.0:1788651235.294639:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:2.0:1788651235.294652:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13864:x1875536389450368:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788651235.295639:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13864:x1875536389450368:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 984us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.295652:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 92 00000100:00100000:0.0:1788651235.309360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.309715:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450496 00000100:00100000:3.0:1788651235.309725:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450496 00000100:00100000:3.0:1788651235.309817:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 93 00000100:00100000:3.0:1788651235.309828:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13874:x1875536389450496:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651235.310138:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13874:x1875536389450496:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 312us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.310147:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 93 00000001:00100000:0.0:1788651235.311066:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788651235.311081:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788651235.311094:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3263d5cc-8db6-4bb2-9e12-fc97a2814380 00000100:00100000:3.0:1788651235.332711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651235.332853:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450624 00000100:00100000:2.0:1788651235.332863:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450624 00000100:00100000:2.0:1788651235.332930:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:2.0:1788651235.332941:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13874:x1875536389450624:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651235.333242:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13874:x1875536389450624:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 302us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.333250:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 94 00000100:00100000:0.0:1788651235.342853:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.345249:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450752 00000100:00100000:3.0:1788651235.345263:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450752 00000100:00100000:3.0:1788651235.345376:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:3.0:1788651235.345388:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13864:x1875536389450752:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788651235.345415:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651235.345435:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56cc00/0x84a2fba887978619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c499 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.345464:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56cc00/0x84a2fba887978619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c499 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.345476:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56cc00/0x84a2fba887978619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c499 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.345486:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56cc00, rc 0) 00000100:00100000:3.0:1788651235.345555:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13864:x1875536389450752:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 170us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.345562:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 95 00000100:00100000:0.0:1788651235.355377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.355549:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389450880 00000100:00100000:3.0:1788651235.355573:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389450880 00000100:00100000:3.0:1788651235.355628:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:3.0:1788651235.355639:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13864:x1875536389450880:12345-192.168.203.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788651235.355664:0:14396:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788651235.355681:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788651235.355685:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788651235.355689:0:14396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788651235.355691:0:14396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788651235.365388:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13864:x1875536389450880:12345-192.168.203.21@tcp:256:mount.lustre.0 Request processed in 9740us (10010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.365403:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 96 00000100:00100000:1.0:1788651235.374506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.378679:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451008 00000100:00100000:3.0:1788651235.378692:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451008 00000100:00100000:3.0:1788651235.378753:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:3.0:1788651235.378763:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13864:x1875536389451008:12345-192.168.203.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788651235.378778:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651235.378796:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4a0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.378983:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.378993:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 13 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651235.379003:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be6d56d200, rc 0) 00000100:00100000:3.0:1788651235.379066:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13864:x1875536389451008:12345-192.168.203.21@tcp:101:mount.lustre.0 Request processed in 304us (4570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.379088:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 97 00000100:00100000:2.0:1788651235.384033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.384138:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451136 00000100:00100000:3.0:1788651235.384148:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451136 00000100:00100000:3.0:1788651235.384191:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:3.0:1788651235.384200:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13864:x1875536389451136:12345-192.168.203.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788651235.384489:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13864:x1875536389451136:12345-192.168.203.21@tcp:501:mount.lustre.0 Request processed in 288us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.384497:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 98 00000100:00100000:1.0:1788651235.388266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651235.388370:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451264 00000100:00100000:2.0:1788651235.388380:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451264 00000100:00100000:2.0:1788651235.388532:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:2.0:1788651235.388557:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13864:x1875536389451264:12345-192.168.203.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788651235.388800:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13864:x1875536389451264:12345-192.168.203.21@tcp:503:mount.lustre.0 Request processed in 244us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.388808:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 99 00000100:00100000:1.0:1788651235.392138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651235.392405:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451392 00000100:00100000:3.0:1788651235.392415:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451392 00000100:00100000:3.0:1788651235.392460:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:3.0:1788651235.392469:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13878:x1875536389451392:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651235.392726:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13878:x1875536389451392:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 257us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651235.392734:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 100 00000100:00100000:1.0:1788651235.399376:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651235.399704:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451520 00000100:00100000:2.0:1788651235.399716:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451520 00000100:00100000:2.0:1788651235.399772:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:2.0:1788651235.399782:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13878:x1875536389451520:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651235.400225:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13878:x1875536389451520:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 442us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.400233:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 101 00000100:00100000:1.0:1788651235.407856:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651235.408955:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451648 00000100:00100000:0.0:1788651235.408967:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451648 00000100:00100000:0.0:1788651235.409025:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1788651235.409035:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875536389451648:12345-192.168.203.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788651235.409063:0:14401:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3b1dbdc5-ee1a-4283-961a-0048bad96b99@192.168.203.21@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1788651235.409147:0:14401:0:(genops.c:1385:class_connect()) connect: client 3b1dbdc5-ee1a-4283-961a-0048bad96b99, cookie 0x84a2fba887978627 00000004:00100000:0.0:1788651235.409178:0:14401:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788651235.409319:0:14401:0:(import.c:65:import_set_state_nolock()) ffff93bd4272f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651235.409387:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:2352:x1875536389451648:12345-192.168.203.21@tcp:38:mount.lustre.0 Request processed in 353us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.409395:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1788651235.421802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651235.421844:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651235.421936:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451904 00000100:00100000:0.0:1788651235.421947:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451904 00000100:00100000:0.0:1788651235.422021:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389451776 00000100:00100000:0.0:1788651235.422025:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389451776 00000100:00100000:0.0:1788651235.422048:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1788651235.422057:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+7:13864:x1875536389451904:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788651235.422086:0:15393:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788651235.422187:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+7:13864:x1875536389451904:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.422194:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1788651235.422213:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:0.0:1788651235.422220:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:0:x1875536389451776:12345-192.168.203.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788651235.422231:0:15393:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788651235.422253:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:0:x1875536389451776:12345-192.168.203.21@tcp:41:mount.lustre.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.422259:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00080000:2.0:1788651235.422631:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651235.425443:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651235.425533:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452032 00000100:00100000:1.0:1788651235.425542:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452032 00000100:00100000:1.0:1788651235.425599:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1788651235.425624:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:13864:x1875536389452032:12345-192.168.203.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788651235.425709:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:13864:x1875536389452032:12345-192.168.203.21@tcp:40:mount.lustre.0 Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651235.425717:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:1.0:1788651235.428353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651235.428390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651235.428430:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651235.428531:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452416 00000100:00100000:0.0:1788651235.428541:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452416 00000100:00100000:0.0:1788651235.428587:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1788651235.428598:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:13864:x1875536389452416:12345-192.168.203.21@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788651235.428670:0:14405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788651235.428745:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:13864:x1875536389452416:12345-192.168.203.21@tcp:33:mount.lustre.0 Request processed in 147us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.428766:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:2.0:1788651235.428840:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452160 00000100:00100000:2.0:1788651235.428844:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452160 00000100:00100000:2.0:1788651235.428875:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452288 00000100:00100000:2.0:1788651235.428879:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452288 00000100:00100000:2.0:1788651235.428904:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1788651235.428909:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389452160:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788651235.428931:0:15083:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3b1dbdc5-ee1a-4283-961a-0048bad96b99@192.168.203.21@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788651235.428971:0:15083:0:(genops.c:1385:class_connect()) connect: client 3b1dbdc5-ee1a-4283-961a-0048bad96b99, cookie 0x84a2fba88797862e 00002000:00100000:2.0:1788651235.428982:0:15083:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3b1dbdc5-ee1a-4283-961a-0048bad96b99/ffff93bd429b9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788651235.428992:0:15083:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788651235.429142:0:15083:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788651235.429171:0:15083:0:(import.c:65:import_set_state_nolock()) ffff93bd429be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651235.429210:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:2352:x1875536389452160:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 299us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.429217:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1788651235.429233:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:2.0:1788651235.429237:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1875536389452288:12345-192.168.203.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788651235.429253:0:15083:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3b1dbdc5-ee1a-4283-961a-0048bad96b99@192.168.203.21@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788651235.429273:0:15083:0:(genops.c:1385:class_connect()) connect: client 3b1dbdc5-ee1a-4283-961a-0048bad96b99, cookie 0x84a2fba887978635 00002000:00100000:2.0:1788651235.429279:0:15083:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3b1dbdc5-ee1a-4283-961a-0048bad96b99/ffff93bd429b8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788651235.429285:0:15083:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788651235.429458:0:15083:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788651235.429473:0:15083:0:(import.c:65:import_set_state_nolock()) ffff93bd429bf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651235.429497:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:2352:x1875536389452288:12345-192.168.203.21@tcp:8:mount.lustre.0 Request processed in 258us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651235.429503:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1788651235.628813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651235.628941:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452544 00000100:00100000:0.0:1788651235.628950:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452544 00000100:00100000:0.0:1788651235.629060:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1788651235.629071:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:13899:x1875536389452544:12345-192.168.203.21@tcp:101:mkdir.0 00010000:00010000:0.0:1788651235.629150:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651235.629172:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba88797863c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4ca expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651235.629235:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651235.629249:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651235.629263:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651235.629297:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788651235.629300:0:14401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788651235.629321:0:14401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651235.629359:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861800/0x84a2fba88797863c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 8 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651235.629377:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 7 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651235.629403:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:0.0:1788651235.629406:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651235.629411:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860e00, rc 0) 00000100:00100000:0.0:1788651235.629465:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+7:13899:x1875536389452544:12345-192.168.203.21@tcp:101:mkdir.0 Request processed in 396us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651235.629472:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00010000:00010000:0.0:1788651236.042799:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651237.061246:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788651237.307662:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b1dbdc5-ee1a-4283-961a-0048bad96b99 00000001:00100000:0.0:1788651237.307685:0:6698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3263d5cc-8db6-4bb2-9e12-fc97a2814380 00010000:00010000:0.0:1788651238.084748:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788651238.362598:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b1dbdc5-ee1a-4283-961a-0048bad96b99 00000001:00100000:0.0:1788651238.362615:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3263d5cc-8db6-4bb2-9e12-fc97a2814380 00000001:02000400:3.0:1788651238.576805:0:16365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788651239.108472:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651240.134740:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651240.324304:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651240.324542:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408314752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651240.324643:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.324730:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408314880:0@lo:400:kworker.0 00000100:00100000:3.0:1788651240.324757:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314752 00000100:00100000:3.0:1788651240.324768:0:15087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314752 00000100:00100000:1.0:1788651240.324773:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.324808:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788651240.324843:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651240.324857:0:15087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408314752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651240.324862:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.324890:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651240.324901:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408315264:0@lo:400:kworker.0 00002000:00000024:3.0:1788651240.324910:0:15087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788651240.324928:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.324959:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408315008:0@lo:400:kworker.0 00000100:00100000:3.0:1788651240.324993:0:15087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408314752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.325001:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.325025:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651240.325031:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788651240.325033:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408315136:0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325059:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.325123:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408315392 00000100:00100000:1.0:1788651240.325128:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408315392 00000100:00100000:1.0:1788651240.325164:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408315264 00000100:00100000:1.0:1788651240.325168:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408315264 00000100:00100000:1.0:1788651240.325192:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408315136 00000100:00100000:2.0:1788651240.325202:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408314880 00000100:00100000:1.0:1788651240.325202:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408315136 00000100:00100000:2.0:1788651240.325209:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408314880 00000100:00100000:1.0:1788651240.325225:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651240.325234:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be74f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408315392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651240.325250:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651240.325263:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408314880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325272:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be74f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875536408315392:12345-0@lo:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.325279:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651240.325297:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651240.325305:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408315264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651240.325312:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408314880:12345-0@lo:400:kworker.0 Request processed in 52us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651240.325321:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788651240.325338:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875536408315264:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.325345:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788651240.325359:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651240.325359:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788651240.325368:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651240.325369:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408315136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325407:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408315136:12345-0@lo:400:kworker.0 Request processed in 39us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.325412:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651240.325435:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408315008 00000100:00100000:1.0:1788651240.325438:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408315008 00000100:00100000:1.0:1788651240.325471:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788651240.325479:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408315008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651240.325503:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408315136:0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325512:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408315008:12345-0@lo:400:kworker.0 Request processed in 33us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.325520:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651240.325524:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408315008:0@lo:400:kworker.0 00000100:00080000:1.0:1788651240.325555:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651240.325577:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875536408315264:0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325587:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408314880:0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875536408315392:0@lo:400:kworker.0 00000100:00100000:1.0:1788651240.325618:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788651240.325636:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408314752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651240.328175:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651240.328204:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408315520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651240.328286:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651240.328369:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408315520 00000100:00100000:1.0:1788651240.328378:0:15087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408315520 00000100:00100000:1.0:1788651240.328546:0:15087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651240.328559:0:15087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408315520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651240.328728:0:15087:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788651240.342099:0:15087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408315520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13530us (13799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651240.342141:0:15087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788651240.342251:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408315520:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788651240.425333:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b1dbdc5-ee1a-4283-961a-0048bad96b99 00000100:00100000:3.0:1788651240.931830:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.931946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.931975:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.931998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.932023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.932042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.932084:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651240.932331:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452928 00000100:00100000:3.0:1788651240.932344:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452928 00000100:00100000:3.0:1788651240.932410:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453440 00000100:00100000:3.0:1788651240.932413:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453440 00000100:00100000:3.0:1788651240.932433:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453056 00000100:00100000:3.0:1788651240.932435:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453056 00000100:00100000:3.0:1788651240.932448:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453312 00000100:00100000:3.0:1788651240.932450:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453312 00000100:00100000:3.0:1788651240.932472:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1788651240.932484:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2355:x1875536389452928:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651240.932580:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2355:x1875536389452928:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 97us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651240.932588:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:3.0:1788651240.932606:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1788651240.932612:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2355:x1875536389453440:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651240.932638:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2355:x1875536389453440:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651240.932656:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1788651240.932665:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1788651240.932674:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1788651240.932680:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2355:x1875536389453056:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651240.932687:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2355:x1875536389453312:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651240.932722:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2355:x1875536389453056:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 48us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651240.932728:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2355:x1875536389453312:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 44us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.932735:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1788651240.932743:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1788651240.932764:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453184 00000100:00100000:1.0:1788651240.932769:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453184 00000100:00100000:1.0:1788651240.932809:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452800 00000100:00100000:1.0:1788651240.932813:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452800 00000100:00100000:1.0:1788651240.932843:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1788651240.932851:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:2355:x1875536389453184:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651240.932885:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:2355:x1875536389453184:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 34us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.932892:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:1.0:1788651240.932924:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1788651240.932934:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2355:x1875536389452800:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651240.932976:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2355:x1875536389452800:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 45us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651240.932983:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00080000:1.0:1788651240.933012:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651240.933017:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651240.933019:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651240.934634:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389452672 00000100:00100000:0.0:1788651240.934647:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389452672 00000100:00100000:0.0:1788651240.934735:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 103 00000100:00100000:0.0:1788651240.934747:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2355:x1875536389452672:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1788651240.934815:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2355:x1875536389452672:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 72us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651240.934838:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 103 00010000:00010000:0.0:1788651241.158628:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651242.181297:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788651242.455779:0:16515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe712f0b60 20000000:00000080:0.0:1788651242.455802:0:16515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93bd41a9fc00 uarg=0000000000000000 20000000:01000000:0.0:1788651242.455927:0:16515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788651242.455935:0:16515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788651242.455941:0:16515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788651242.459732:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788651242.460068:0:16515:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788651242.470469:0:16515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788651242.470613:0:16515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470641:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797833a expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470650:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba887978387 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470658:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797840c expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470669:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470677:0:16515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470684:0:16515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470744:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 12 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.470763:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 12 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.470780:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408315648:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651242.471576:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.471613:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 12 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.471626:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408315776:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651242.471676:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797840c expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.471686:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797840c expref: 18 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.471697:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408315904:0@lo:104: 00000100:00100000:2.0:1788651242.471747:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788651242.472068:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba887978387 expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.472079:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba887978387 expref: 18 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.472090:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75568380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408316032:0@lo:104: 00000100:00100000:2.0:1788651242.472134:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651242.474895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651242.475394:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453568 00000100:00100000:1.0:1788651242.475411:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453568 00010000:00010000:1.0:1788651242.475470:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 13 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651242.475516:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1788651242.475527:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2356:x1875536389453568:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651242.475548:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651242.475554:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 13 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.475570:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 13 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.475596:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651242.475657:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2356:x1875536389453568:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 132us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.475665:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00010000:00010000:2.0:1788651242.479262:0:16515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84a2fba88797833a expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.479301:0:16515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84a2fba88797833a expref: 18 pid: 14395 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.479324:0:16515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408316160:0@lo:104: 00000100:00100000:2.0:1788651242.479543:0:16515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651242.479633:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408315904 00000100:00100000:0.0:1788651242.479645:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408315904 00000100:00100000:1.0:1788651242.479802:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316032 00000100:00100000:1.0:1788651242.479808:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316032 00000100:00100000:1.0:1788651242.480390:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788651242.480410:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+4:16515:x1875536408315904:12345-0@lo:104: 00010000:00010000:1.0:1788651242.480431:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480520:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788651242.480527:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+4:16515:x1875536408315904:12345-0@lo:104: Request processed in 126us (8780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.480535:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788651242.480561:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651242.480567:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:16515:x1875536408316032:12345-0@lo:104: 00010000:00010000:1.0:1788651242.480576:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480614:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788651242.480620:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:16515:x1875536408316032:12345-0@lo:104: Request processed in 53us (8486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.480626:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788651242.480648:0:16123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651242.480656:0:16123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480665:0:16123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c200 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651242.480670:0:16123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480680:0:16123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651242.480702:0:16123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651242.480709:0:16123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788651242.480753:0:16123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480760:0:16123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651242.480784:0:16123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480792:0:16123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be7fe9c200/0x84a2fba88797840c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978413 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480805:0:16123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651242.480808:0:16123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480814:0:16123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56d600 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651242.480817:0:16123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.480824:0:16123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651242.480829:0:16123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651242.480834:0:16123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651242.481214:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651242.481447:0:16123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.481456:0:16123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651242.481485:0:16123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.481493:0:16123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be6d56d600/0x84a2fba887978387 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba88797838e expref: -99 pid: 15081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.481503:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651242.481505:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651242.481506:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651242.481537:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408316288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651242.481586:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651242.481645:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651242.481653:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408316416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651242.481679:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651242.481704:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316288 00000100:00100000:1.0:1788651242.481711:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316288 00010000:00010000:1.0:1788651242.481738:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797840c expref: 19 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651242.481763:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316416 00000100:00100000:1.0:1788651242.481766:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316416 00010000:00010000:1.0:1788651242.481778:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887978387 expref: 20 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651242.481790:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651242.481797:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+20:3307:x1875536408316288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651242.481818:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651242.481824:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797840c expref: 20 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.481846:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797840c expref: 20 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651242.482425:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:1.0:1788651242.482587:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651242.482640:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+20:3307:x1875536408316288:12345-0@lo:103:ldlm_bl.0 Request processed in 842us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.482650:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651242.482667:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453696 00000100:00100000:1.0:1788651242.482672:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453696 00010000:00010000:1.0:1788651242.482688:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 13 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651242.482703:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651242.482709:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408316416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651242.482720:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651242.482725:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba887978387 expref: 19 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.482734:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba887978387 expref: 19 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.482744:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651242.482771:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3309:x1875536408316416:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.482777:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651242.482830:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1788651242.482849:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2353:x1875536389453696:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651242.482859:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651242.482872:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 13 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.483280:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 13 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.483424:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651242.483516:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2353:x1875536389453696:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 677us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.483524:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1788651242.483567:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3309:1875536408316416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651242.483653:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408316288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788651242.483809:0:16515:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7555c780 going to sleep for 11 seconds 00010000:00010000:2.0:1788651242.483829:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be6d56d200/0x84a2fba887978620 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4a0 expref: 12 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.483855:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408315648:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651242.483884:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93bd42f07800/0x84a2fba8879785e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c43e expref: 11 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.483894:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408315776:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651242.483905:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be7fe9d400/0x84a2fba887978413 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797840c expref: 18 pid: 14394 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.483913:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408315904:0@lo:104: 00010000:00010000:2.0:1788651242.483923:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be4618be00/0x84a2fba88797838e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba887978387 expref: 17 pid: 14396 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.483932:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75568380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408316032:0@lo:104: 00000100:00100000:1.0:1788651242.484223:0:14384:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788651242.484239:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316160 00000100:00100000:1.0:1788651242.484244:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316160 00000100:00100000:1.0:1788651242.484293:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651242.484301:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be77435850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:16515:x1875536408316160:12345-0@lo:104: 00010000:00010000:1.0:1788651242.484316:0:14384:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.484503:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788651242.484510:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be77435850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+3:16515:x1875536408316160:12345-0@lo:104: Request processed in 211us (4970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.484517:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788651242.484569:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651242.484587:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.484595:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be6d56da00 already unused, calling callback (ffffffffc1d2ec20) 10000000:00010000:1.0:1788651242.484599:0:14390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.484609:0:14390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651242.484616:0:14390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651242.484622:0:14390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788651242.484658:0:14390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.484665:0:14390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651242.484686:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.484693:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff93be6d56da00/0x84a2fba88797833a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84a2fba887978341 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.484709:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651242.484712:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651242.484713:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651242.484721:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651242.484734:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3308:1875536408316544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651242.484772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651242.484801:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316544 00000100:00100000:1.0:1788651242.484812:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316544 00010000:00010000:1.0:1788651242.484829:0:14388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797833a expref: 17 pid: 14395 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651242.486080:0:16515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16515:1875536408316160:0@lo:104: 00010000:00010000:2.0:1788651242.486145:0:16515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651242.486430:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651242.486446:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:3308:x1875536408316544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651242.486463:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651242.486472:0:14388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84a2fba88797833a expref: 17 pid: 14395 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486485:0:14388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84a2fba88797833a expref: 17 pid: 14395 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486508:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93be75861c00/0x84a2fba887978341 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84a2fba88797833a expref: 17 pid: 14395 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486525:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486535:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486552:0:14388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486560:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486568:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486575:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486596:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07c00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651242.486601:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486610:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486633:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651242.486644:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651242.486710:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:3308:x1875536408316544:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651242.486718:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651242.486770:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3308:1875536408316544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651242.486955:0:16515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.486963:0:16515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651242.486970:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93bd42f07c00/0x84a2fba88797864a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651242.503772:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788651243.204388:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651244.126895:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651244.126930:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453824 00000100:00100000:2.0:1788651244.126940:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453824 00000100:00100000:2.0:1788651244.126987:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:2.0:1788651244.126998:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+11:13753:x1875536389453824:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651244.127015:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651244.127032:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93bd42f07600/0x84a2fba887978651 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4d1 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.127074:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93bd42f07600/0x84a2fba887978651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4d1 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.127085:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93bd42f07600/0x84a2fba887978651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4d1 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.127095:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07600, rc 0) 00000100:00100000:2.0:1788651244.127170:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13753:x1875536389453824:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 174us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651244.127177:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 104 00000100:00100000:1.0:1788651244.138006:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651244.138577:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389453952 00000100:00100000:0.0:1788651244.138588:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389453952 00000100:00100000:0.0:1788651244.138905:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:0.0:1788651244.138916:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13753:x1875536389453952:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651244.139878:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13753:x1875536389453952:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 959us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651244.139889:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 105 00000100:00100000:3.0:1788651244.142166:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651244.142284:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454080 00000100:00100000:1.0:1788651244.142293:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454080 00000100:00100000:1.0:1788651244.142886:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:1.0:1788651244.142900:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13753:x1875536389454080:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651244.143262:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13753:x1875536389454080:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 365us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651244.143271:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 106 00000100:00100000:1.0:1788651244.150248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651244.150316:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454208 00000100:00100000:0.0:1788651244.150403:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454208 00000100:00100000:0.0:1788651244.150612:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:0.0:1788651244.150623:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+12:13753:x1875536389454208:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651244.150640:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651244.150658:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be75860000/0x84a2fba887978658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4d8 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651244.150954:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be75860000/0x84a2fba887978658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4d8 expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651244.150966:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be75860000/0x84a2fba887978658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4d8 expref: 13 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651244.150977:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860000, rc 0) 00000100:00100000:0.0:1788651244.151047:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13753:x1875536389454208:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 417us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651244.151054:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 107 00000100:00100000:1.0:1788651244.153439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651244.153569:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454336 00000100:00100000:3.0:1788651244.153579:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454336 00000100:00100000:3.0:1788651244.153632:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:3.0:1788651244.153643:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13753:x1875536389454336:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.153923:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13753:x1875536389454336:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 281us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651244.153932:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 108 00000100:00100000:3.0:1788651244.156935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651244.157159:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454464 00000100:00100000:0.0:1788651244.157170:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454464 00000100:00100000:0.0:1788651244.157228:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 109 00000100:00100000:0.0:1788651244.157238:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13753:x1875536389454464:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651244.157464:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:13753:x1875536389454464:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 227us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651244.157473:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 109 10000000:01000000:1.0:1788651244.164161:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651244.164169:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93bd43073000 from 10 10000000:01000000:1.0:1788651244.164174:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651244.164226:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.164236:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.164246:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651244.164269:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408316672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651244.164332:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651244.164382:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651244.164506:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316672 00000100:00100000:0.0:1788651244.164513:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316672 00000100:00100000:0.0:1788651244.164563:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651244.164574:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+16:14398:x1875536408316672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651244.164587:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651244.164608:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be75860800/0x84a2fba887978666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797865f expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651244.164629:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be75860800/0x84a2fba887978666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797865f expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651244.164647:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be75860800/0x84a2fba887978666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797865f expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651244.164656:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75860800, rc 0) 00000100:00100000:0.0:1788651244.164705:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:14398:x1875536408316672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651244.164711:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788651244.167730:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408316672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651244.167761:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978666 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.167774:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978666 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651244.167855:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408316800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.167925:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651244.167973:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be53a1acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651244.168338:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316800 00000100:00100000:3.0:1788651244.169233:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316800 00000100:00100000:3.0:1788651244.169303:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788651244.169313:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:14398:x1875536408316800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.169822:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:14398:x1875536408316800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 509us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651244.169830:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788651244.172806:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408316800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.172873:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408316928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.173066:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651244.173470:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408316928 00000100:00100000:3.0:1788651244.173477:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408316928 00000100:00100000:3.0:1788651244.173527:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788651244.173537:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:14398:x1875536408316928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.173725:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:14398:x1875536408316928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651244.173732:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788651244.173902:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be53a1acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651244.173920:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408316928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788651244.177578:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788651244.177808:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788651244.177832:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651244.177843:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978666 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.177854:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9dc00/0x84a2fba88797865f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978666 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651244.177865:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651244.177867:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7be43800 from 10 10000000:01000000:1.0:1788651244.177870:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651244.177904:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.177912:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.177936:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651244.177959:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be45a79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651244.178026:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651244.178075:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651244.178298:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317056 00000100:00100000:3.0:1788651244.178305:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317056 00000100:00100000:1.0:1788651244.178662:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788651244.178673:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+17:14398:x1875536408317056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651244.178687:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651244.178700:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93be7fe9c600/0x84a2fba887978674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797866d expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.178722:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93be7fe9c600/0x84a2fba887978674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797866d expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.178733:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93be7fe9c600/0x84a2fba887978674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797866d expref: 18 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.178743:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c600, rc 0) 00000100:00100000:1.0:1788651244.178827:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408317056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651244.178835:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788651244.181771:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be45a79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651244.181799:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978674 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.181811:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978674 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651244.181892:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.181946:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651244.181980:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4611db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651244.181996:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317184 00000100:00100000:2.0:1788651244.182002:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317184 00000100:00100000:2.0:1788651244.182049:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788651244.182058:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408317184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.182334:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75564850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408317184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651244.182342:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788651244.183007:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.183060:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.183136:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651244.183162:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be4611db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651244.183678:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317312 00000100:00100000:1.0:1788651244.183685:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317312 00000100:00100000:1.0:1788651244.183717:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788651244.183726:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408317312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651244.183898:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408317312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651244.183913:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788651244.184011:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be75569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788651244.187004:0:16596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788651244.187474:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788651244.187499:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651244.187511:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978674 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651244.187523:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be7fe9ce00/0x84a2fba88797866d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978674 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651244.187533:0:14398:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651244.187536:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93be7c1e4800 from 10 10000000:01000000:3.0:1788651244.187539:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651244.187574:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651244.187582:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651244.187603:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651244.187629:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.187692:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651244.187737:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be460670c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651244.187790:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317440 00000100:00100000:2.0:1788651244.187797:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317440 00000100:00100000:2.0:1788651244.187843:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788651244.187852:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+18:14398:x1875536408317440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651244.187865:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651244.187876:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93bd42f06800/0x84a2fba887978682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84a2fba88797867b expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.187898:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93bd42f06800/0x84a2fba887978682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84a2fba88797867b expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.187909:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93bd42f06800/0x84a2fba887978682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84a2fba88797867b expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.187917:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06800, rc 0) 00000100:00100000:2.0:1788651244.187955:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408317440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651244.187962:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788651244.188048:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651244.188061:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978682 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651244.188070:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84a2fba887978682 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651244.188152:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.188176:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651244.188196:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be460670c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651244.188253:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317568 00000100:00100000:2.0:1788651244.188257:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317568 00000100:00100000:2.0:1788651244.188286:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788651244.188293:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408317568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.188522:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408317568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651244.188534:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788651244.188783:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.188818:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651244.188856:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651244.188879:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be460670c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651244.188925:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317696 00000100:00100000:2.0:1788651244.188930:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317696 00000100:00100000:2.0:1788651244.188990:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788651244.188997:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408317696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651244.189178:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:14398:x1875536408317696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651244.189184:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788651244.189496:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:14398:1875536408317696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788651244.192056:0:16597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788651244.192596:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788651244.192617:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651244.192629:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978682 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651244.192640:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff93be429ca200/0x84a2fba88797867b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84a2fba887978682 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651244.228598:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651245.255304:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651245.444564:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408317824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651245.444576:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408317952:0@lo:400:kworker.0 00000100:00100000:0.0:1788651245.444707:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408318080:0@lo:400:kworker.0 00000100:00100000:3.0:1788651245.445152:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408318208:0@lo:400:kworker.0 00000100:00100000:2.0:1788651245.447960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651245.448317:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788651245.448483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651245.448594:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408318464 00000100:00100000:2.0:1788651245.448603:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408318464 00000100:00100000:2.0:1788651245.448659:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651245.448668:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408318464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651245.448715:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408318464:12345-0@lo:400:kworker.0 Request processed in 49us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651245.448738:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651245.448780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788651245.448892:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317952 00000100:00100000:2.0:1788651245.448897:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317952 00000100:00100000:2.0:1788651245.448920:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788651245.448926:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3307:x1875536408317952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651245.448959:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3307:x1875536408317952:12345-0@lo:400:kworker.0 Request processed in 33us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651245.448965:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788651245.449331:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3307:1875536408317952:0@lo:400:kworker.0 00000100:00080000:2.0:1788651245.449484:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651245.450282:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651245.450337:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408318336:0@lo:400:kworker.0 00000100:00100000:1.0:1788651245.450374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651245.450405:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408318336 00000100:00100000:1.0:1788651245.450411:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408318336 00000100:00100000:1.0:1788651245.450598:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788651245.450607:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408318336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651245.450653:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875536408318336:12345-0@lo:400:kworker.0 Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651245.450659:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788651245.450699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875536408318336:0@lo:400:kworker.0 00000100:00100000:2.0:1788651245.450800:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408317824 00000100:00100000:2.0:1788651245.450805:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408317824 00000100:00100000:2.0:1788651245.450928:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788651245.450936:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408317824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651245.451044:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651245.451089:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408317824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651245.451095:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651245.451218:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651245.451245:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408318592:0@lo:400:kworker.0 00000100:00100000:0.0:1788651245.451271:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651245.451348:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408318592 00000100:00100000:1.0:1788651245.451353:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408318592 00000100:00100000:1.0:1788651245.451389:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651245.451396:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408318592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651245.451431:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408318592:12345-0@lo:400:kworker.0 Request processed in 36us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651245.451437:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788651245.451454:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651245.451458:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651245.451485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408317824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651245.451621:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651245.451654:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408318080 00000100:00100000:3.0:1788651245.451658:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408318080 00000100:00100000:3.0:1788651245.451684:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408318208 00000100:00100000:3.0:1788651245.451687:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408318208 00000100:00100000:3.0:1788651245.451702:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651245.451709:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408318080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651245.451741:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408318080:12345-0@lo:400:kworker.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651245.451747:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651245.451760:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788651245.451766:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408318208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651245.451793:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408318208:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651245.451798:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788651245.451896:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408318208:0@lo:400:kworker.0 00000100:00100000:3.0:1788651245.451905:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408318720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651245.451932:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651245.452058:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408318080:0@lo:400:kworker.0 00000100:00100000:0.0:1788651245.452068:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408318592:0@lo:400:kworker.0 00000100:00080000:1.0:1788651245.452234:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651245.452312:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408318720 00000100:00100000:2.0:1788651245.452317:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408318720 00000100:00100000:2.0:1788651245.452339:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788651245.452346:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408318720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651245.452369:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651245.452415:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875536408318720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651245.452429:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788651245.453650:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875536408318720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651245.894234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651245.894340:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454592 00000100:00100000:2.0:1788651245.894361:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454592 00000100:00100000:2.0:1788651245.894477:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1788651245.894488:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:14409:x1875536389454592:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651245.894508:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651245.894529:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4df expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.894590:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.894605:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.894618:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.894633:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.894641:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.894648:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895266:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06000/0x84a2fba88797869e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895290:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06000/0x84a2fba88797869e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895299:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06000/0x84a2fba88797869e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651245.895326:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651245.895330:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651245.895378:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06000/0x84a2fba88797869e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895390:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895396:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895402:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895408:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651245.895412:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895419:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895430:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:2.0:1788651245.895433:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651245.895437:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895453:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895466:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895472:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895477:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895482:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651245.895485:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895491:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895499:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93be61d23f00) 00010000:00010000:2.0:1788651245.895502:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651245.895505:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895510:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895543:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4df expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895570:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06000/0x84a2fba88797869e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4df expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.895577:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93be61d23100) 00010000:00010000:2.0:1788651245.895579:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651245.895582:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06000, rc 0) 00000100:00100000:2.0:1788651245.895645:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:14409:x1875536389454592:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1159us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651245.895654:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00080000:1.0:1788651245.896608:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651245.901667:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651245.901755:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454848 00000100:00100000:1.0:1788651245.901765:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454848 00000100:00100000:1.0:1788651245.901866:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651245.901877:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:14409:x1875536389454848:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651245.901896:0:15393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651245.902038:0:15393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d000/0x84a2fba8879786a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4e6 expref: -99 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902140:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902155:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902169:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902218:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902226:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902234:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902581:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d400/0x84a2fba8879786ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902590:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d400/0x84a2fba8879786ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902597:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d400/0x84a2fba8879786ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651245.902608:0:15393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788651245.902799:0:15393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902808:0:15393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902827:0:15393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902834:0:15393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9d600 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651245.902838:0:15393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902845:0:15393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902856:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93be61d23100) 00010000:00010000:1.0:1788651245.902859:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651245.902864:0:15393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902882:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.902895:0:15393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903260:0:15393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903266:0:15393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903271:0:15393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651245.903274:0:15393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903280:0:15393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903288:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93be58f79a00) 00010000:00010000:1.0:1788651245.903290:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651245.903293:0:15393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903298:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903753:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d000/0x84a2fba8879786a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4e6 expref: 10 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903779:0:15393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d400/0x84a2fba8879786ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4e6 expref: 9 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651245.903787:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be58f79f00) 00010000:00010000:1.0:1788651245.903790:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651245.903792:0:15393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d400, rc 0) 00000100:00100000:1.0:1788651245.904069:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14409:x1875536389454848:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 2192us (2410us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788651245.904078:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:2.0:1788651245.908623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651245.908698:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389454976 00000100:00100000:0.0:1788651245.908707:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389454976 00000100:00100000:0.0:1788651245.908758:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1788651245.908767:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14409:x1875536389454976:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788651245.908859:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14409:x1875536389454976:12345-192.168.203.21@tcp:59:lhsmtool_posix.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651245.908866:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1788651245.975400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651245.975704:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389455104 00000100:00100000:2.0:1788651245.975715:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389455104 00000100:00100000:2.0:1788651245.975844:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:2.0:1788651245.975855:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14415:x1875536389455104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651245.975875:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651245.975897:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879786c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4ed expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.975965:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.975980:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.975994:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.976520:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.976529:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.976537:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977515:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977531:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977538:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977544:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651245.977548:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977556:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977570:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:2.0:1788651245.977573:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651245.977578:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977584:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977742:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977749:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977755:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977760:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651245.977763:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977769:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977777:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93be61d23f00) 00010000:00010000:2.0:1788651245.977780:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651245.977784:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977790:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977833:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879786c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ed expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977843:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:2.0:1788651245.977846:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651245.977856:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879786c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ed expref: 10 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651245.977867:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07a00, rc 0) 00000100:00100000:2.0:1788651245.978017:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14415:x1875536389455104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 2162us (2622us total) trans 0 rc 301/301 00000100:00100000:2.0:1788651245.978037:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:2.0:1788651245.996191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651245.997589:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389455232 00000100:00100000:0.0:1788651245.997615:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389455232 00000100:00100000:0.0:1788651245.997678:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1788651245.997702:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14415:x1875536389455232:12345-192.168.203.21@tcp:700:lfs.0 00000100:00100000:0.0:1788651245.998145:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14415:x1875536389455232:12345-192.168.203.21@tcp:700:lfs.0 Request processed in 443us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651245.998154:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1788651246.006307:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651246.006521:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389455488 00000100:00100000:0.0:1788651246.006534:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389455488 00000100:00100000:0.0:1788651246.006622:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:0.0:1788651246.006635:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14415:x1875536389455488:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:0.0:1788651246.006713:0:16276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651246.006747:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be6d56c800/0x84a2fba88797860b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c468 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.006771:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:0.0:1788651246.006777:0:16276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651246.007266:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.007285:0:16276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 5 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.007297:0:16276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.007340:0:16276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 5 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.007358:0:16276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 5 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651246.007390:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408318848:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651246.007507:0:16276:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1788651246.010141:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408318848:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651246.010184:0:16276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651246.010873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.010965:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389455616 00000100:00100000:1.0:1788651246.010980:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389455616 00010000:00010000:1.0:1788651246.011064:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 6 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.011144:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1788651246.011155:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:2355:x1875536389455616:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651246.011172:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651246.011180:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 6 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788651246.011196:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788651246.011197:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 6 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.011226:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba887978643 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4ca expref: 6 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.011368:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:1.0:1788651246.011375:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.011383:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.011390:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.011426:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651246.011456:0:16276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.011467:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.011494:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.011506:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.011515:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.016663:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2355:x1875536389455616:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 5496us (5780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.016679:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000004:00200000:2.0:1788651246.018649:0:16276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788651246.018669:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.018680:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.018687:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.018706:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.018710:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.018718:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.018736:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be501e3400) 00010000:00010000:2.0:1788651246.018739:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.018744:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.018751:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861200/0x84a2fba8879786dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651246.018773:0:16276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b49bb7ed reply state 0000000057e57052 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.018783:0:16276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651246.018881:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+10:14415:x1875536389455488:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 12246us (12589us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788651246.018890:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00010000:00010000:3.0:1788651246.023671:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.023690:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.023699:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.023723:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651246.023727:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.023736:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.023753:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93be61d23f00) 00010000:00010000:3.0:1788651246.023757:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651246.023762:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.023769:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba8879786e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.050466:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.050511:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.050542:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.050619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.050649:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389455872 00000100:00100000:2.0:1788651246.050658:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389455872 00000100:00100000:2.0:1788651246.050709:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456128 00000100:00100000:3.0:1788651246.050722:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456000 00000100:00100000:2.0:1788651246.050724:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456128 00000100:00100000:3.0:1788651246.050726:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456000 00000100:00100000:2.0:1788651246.050742:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456256 00000100:00100000:2.0:1788651246.050745:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456256 00000100:00100000:2.0:1788651246.050761:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:2.0:1788651246.050783:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2353:x1875536389455872:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651246.050824:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1788651246.050832:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2353:x1875536389456128:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1788651246.050903:0:15083:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788651246.050912:0:15083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788651246.050917:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2353:x1875536389456128:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 86us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651246.050924:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1788651246.050941:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:3.0:1788651246.050947:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2353:x1875536389456256:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1788651246.050970:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:2353:x1875536389456256:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651246.050976:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651246.051033:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1788651246.051041:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2353:x1875536389456000:12345-192.168.203.21@tcp:400:kworker.0 00000100:00080000:3.0:1788651246.051058:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651246.051062:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651246.051068:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2353:x1875536389456000:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.051074:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:2.0:1788651246.051727:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2353:x1875536389455872:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 944us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651246.051735:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:3.0:1788651246.054704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.055927:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389455744 00000100:00100000:2.0:1788651246.055940:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389455744 00000100:00100000:2.0:1788651246.056018:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:2.0:1788651246.056038:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2354:x1875536389455744:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1788651246.056468:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ff11768-8c10-4a90-9fc6-27ef378342b1+13:2354:x1875536389455744:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 438us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651246.056476:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:3.0:1788651246.163513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.163620:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456384 00000100:00100000:1.0:1788651246.163630:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456384 00000100:00100000:1.0:1788651246.163691:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651246.163703:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14423:x1875536389456384:12345-192.168.203.21@tcp:101:lctl.0 00010000:00010000:1.0:1788651246.163726:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651246.163771:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4f4 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.163850:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.163864:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.163876:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651246.163909:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788651246.163913:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651246.163950:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.163973:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba8879786eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4f4 expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.163991:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d600/0x84a2fba8879786f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4f4 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.164001:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:1.0:1788651246.164003:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651246.164007:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9d600, rc 0) 00000100:00100000:1.0:1788651246.164077:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+10:14423:x1875536389456384:12345-192.168.203.21@tcp:101:lctl.0 Request processed in 376us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.164084:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:1.0:1788651246.201880:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.201987:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456512 00000100:00100000:2.0:1788651246.201997:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456512 00000100:00100000:2.0:1788651246.202070:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1788651246.202081:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+5:14424:x1875536389456512:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651246.202101:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.202149:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c4fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.202214:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba887978700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.202229:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba887978700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.202248:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba887978700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.202285:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651246.202289:0:14403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651246.202308:0:14403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba887978700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.202331:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba8879786f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4fb expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.202362:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07200/0x84a2fba887978700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c4fb expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.202371:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:2.0:1788651246.202374:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651246.202378:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07200, rc 0) 00000100:00100000:2.0:1788651246.202442:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:14424:x1875536389456512:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 362us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651246.202449:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:0.0:1788651246.217146:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.217241:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456640 00000100:00100000:2.0:1788651246.217262:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456640 00000100:00100000:2.0:1788651246.217318:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:2.0:1788651246.217329:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b1dbdc5-ee1a-4283-961a-0048bad96b99+6:14424:x1875536389456640:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651246.217358:0:16276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.217378:0:16276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c502 expref: -99 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217461:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217476:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217487:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217503:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217510:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217517:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217605:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06e00/0x84a2fba88797871c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217613:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06e00/0x84a2fba88797871c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217620:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06e00/0x84a2fba88797871c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.217650:0:16276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651246.217654:0:16276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651246.217672:0:16276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06e00/0x84a2fba88797871c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217694:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217701:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217708:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217713:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.217718:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217725:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217737:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:2.0:1788651246.217740:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.217745:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217751:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba88797870e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217763:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217769:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217774:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217786:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.217789:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217795:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217804:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93be61d23800) 00010000:00010000:2.0:1788651246.217807:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.217821:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217828:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217860:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c502 expref: 8 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217873:0:16276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06e00/0x84a2fba88797871c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c502 expref: 7 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.217879:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be61d23f00) 00010000:00010000:2.0:1788651246.217881:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651246.217884:0:16276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06e00, rc 0) 00000100:00100000:2.0:1788651246.217949:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3b1dbdc5-ee1a-4283-961a-0048bad96b99+7:14424:x1875536389456640:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 622us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651246.217956:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:3.0:1788651246.224222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.224583:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389456896 00000100:00100000:2.0:1788651246.224610:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389456896 00000100:00100000:2.0:1788651246.224687:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:2.0:1788651246.224699:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+7:14424:x1875536389456896:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651246.224729:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.224758:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c509 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.224889:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788651246.225188:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978723 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c509 expref: 9 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.225206:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:2.0:1788651246.225209:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651246.225216:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07000/0x84a2fba887978723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c509 expref: 9 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.225232:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07000, rc 0) 00000100:00100000:2.0:1788651246.225314:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+8:14424:x1875536389456896:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 617us (1105us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788651246.225322:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:0.0:1788651246.231055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.231175:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389457152 00000100:00100000:1.0:1788651246.231188:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389457152 00000100:00100000:1.0:1788651246.231251:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:1.0:1788651246.231263:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+8:14424:x1875536389457152:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:1.0:1788651246.231323:0:15393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651246.231350:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06e00/0x84a2fba88797871c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c502 expref: 8 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.231369:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be61d23f00) 00010000:00010000:1.0:1788651246.231380:0:15393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651246.231403:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.231415:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.231425:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651246.231632:0:15393:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a137fce reply state 0000000031888a40 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.231641:0:15393:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788651246.231649:0:15393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788651246.231743:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b1dbdc5-ee1a-4283-961a-0048bad96b99+9:14424:x1875536389457152:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 481us (698us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788651246.231750:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00010000:00010000:1.0:1788651246.238582:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.238630:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.238639:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.238645:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651246.238651:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.238661:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.238682:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be58f79600) 00010000:00010000:1.0:1788651246.238685:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788651246.238692:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.238700:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c400/0x84a2fba887978731 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651246.239102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.239441:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389457408 00000100:00100000:1.0:1788651246.239454:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389457408 00000100:00100000:1.0:1788651246.239521:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:1.0:1788651246.239534:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+8:14424:x1875536389457408:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651246.240054:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+9:14424:x1875536389457408:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 520us (957us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788651246.240063:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1788651246.246421:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.246621:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389457664 00000100:00100000:1.0:1788651246.246653:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389457664 00000100:00100000:1.0:1788651246.246725:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1788651246.246736:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+9:14424:x1875536389457664:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651246.246768:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651246.246796:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887978738 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c510 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.246921:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.246939:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.246961:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.246979:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.246986:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.246993:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651246.247179:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788651246.247295:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247304:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247322:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247329:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9c000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651246.247334:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247343:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247363:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:1.0:1788651246.247366:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651246.247372:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247379:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c000/0x84a2fba88797873f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247394:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247401:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247407:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247411:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be7fe9cc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651246.247414:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247430:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247438:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93be58f79800) 00010000:00010000:1.0:1788651246.247440:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651246.247444:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247450:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9cc00/0x84a2fba887978746 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247498:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887978738 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c510 expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247509:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:1.0:1788651246.247512:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651246.247516:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9c200/0x84a2fba887978738 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c510 expref: 11 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.247524:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be7fe9c200, rc 0) 00000100:00100000:1.0:1788651246.247756:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+10:14424:x1875536389457664:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1021us (1349us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788651246.247828:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:3.0:1788651246.255018:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.255102:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389457792 00000100:00100000:1.0:1788651246.255142:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389457792 00000100:00100000:1.0:1788651246.255211:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:1.0:1788651246.255221:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+10:14424:x1875536389457792:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1788651246.255275:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651246.255310:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d000/0x84a2fba887978754 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c517 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.255422:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.255440:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.255464:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651246.255494:0:14401:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788651246.255498:0:14401:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788651246.255520:0:14401:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.255552:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be7fe9d000/0x84a2fba887978754 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.255573:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.255582:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be58f79d00) 00010000:00010000:1.0:1788651246.255586:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651246.255589:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:1.0:1788651246.255859:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+11:14424:x1875536389457792:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 637us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.255879:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:0.0:1788651246.262281:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.262579:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389457920 00000100:00100000:1.0:1788651246.262591:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389457920 00000100:00100000:1.0:1788651246.262675:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1788651246.262688:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+11:14424:x1875536389457920:12345-192.168.203.21@tcp:37:lfs.0 00000100:00100000:0.0:1788651246.268276:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+11:14424:x1875536389457920:12345-192.168.203.21@tcp:37:lfs.0 Request processed in 5574us (5991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651246.268294:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00010000:00010000:3.0:1788651246.276426:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651246.280451:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651246.281560:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389458176 00000100:00100000:0.0:1788651246.281578:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389458176 00000100:00100000:0.0:1788651246.281656:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1788651246.281669:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46134850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+11:14424:x1875536389458176:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1788651246.282074:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46134850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b1dbdc5-ee1a-4283-961a-0048bad96b99+12:14424:x1875536389458176:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 406us (1637us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788651246.282083:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1788651246.332677:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.332875:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389458304 00000100:00100000:2.0:1788651246.332889:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389458304 00000100:00100000:2.0:1788651246.332967:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:2.0:1788651246.332979:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+10:14430:x1875536389458304:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:2.0:1788651246.333005:0:15393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.333041:0:15393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c51e expref: -99 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333306:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333324:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333338:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333356:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333363:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333370:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333488:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06a00/0x84a2fba887978777 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333498:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06a00/0x84a2fba887978777 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333505:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06a00/0x84a2fba887978777 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.333537:0:15393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788651246.333541:0:15393:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651246.333587:0:15393:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06a00/0x84a2fba887978777 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333612:0:15393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333619:0:15393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333627:0:15393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333632:0:15393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.333637:0:15393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333646:0:15393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333660:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:2.0:1788651246.333664:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.333669:0:15393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333676:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba887978769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333693:0:15393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333699:0:15393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333705:0:15393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333716:0:15393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.333719:0:15393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333725:0:15393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333732:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93be61d23800) 00010000:00010000:2.0:1788651246.333735:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.333737:0:15393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333743:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978770 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333780:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba887978762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c51e expref: 12 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333797:0:15393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06a00/0x84a2fba887978777 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c51e expref: 11 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.333805:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be58f79d00) 00010000:00010000:2.0:1788651246.333808:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788651246.335186:0:15393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06a00, rc 0) 00000100:00100000:2.0:1788651246.335301:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+11:14430:x1875536389458304:12345-192.168.203.21@tcp:101:bash.0 Request processed in 2318us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651246.335312:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:1.0:1788651246.344351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651246.344519:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389458560 00000100:00100000:3.0:1788651246.344540:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389458560 00000100:00100000:3.0:1788651246.344620:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:3.0:1788651246.344634:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+11:14430:x1875536389458560:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651246.344662:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651246.344694:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cac00/0x84a2fba88797877e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c525 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.346181:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.346225:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.346235:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.346485:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.346517:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 11 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.346543:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14402:1875536408318976:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651246.346682:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7555c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788651246.349494:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14402:1875536408318976:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651246.349534:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.354535:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651246.354655:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389458688 00000100:00100000:0.0:1788651246.354669:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389458688 00010000:00010000:0.0:1788651246.354729:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 12 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651246.354805:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1788651246.354826:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+12:2353:x1875536389458688:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651246.354847:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651246.354855:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 12 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.354870:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 12 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.354896:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797875b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c517 expref: 12 pid: 14401 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.354917:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be58f79d00) 00010000:00010000:0.0:1788651246.354923:0:14387:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.354935:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.354943:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.354981:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651246.355058:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b1dbdc5-ee1a-4283-961a-0048bad96b99+11:2353:x1875536389458688:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 234us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651246.355066:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00010000:00010000:2.0:1788651246.355372:0:14402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.355382:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.355414:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.355426:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.355444:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356446:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356461:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356471:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.356485:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788651246.356521:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356545:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356552:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356558:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f06c00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.356564:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356573:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356587:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be58f79d00) 00010000:00010000:2.0:1788651246.356591:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.356606:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356613:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba887978785 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651246.356628:0:14402:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000835e2f79 reply state 00000000746abb3f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.356638:0:14402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788651246.356681:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cac00/0x84a2fba88797877e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 14 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356698:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 13 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.356706:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:2.0:1788651246.356708:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788651246.356710:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06200, rc 0) 00000100:00100000:2.0:1788651246.356782:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+14:14430:x1875536389458560:12345-192.168.203.21@tcp:101:bash.0 Request processed in 12151us (12446us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788651246.356791:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00010000:00010000:2.0:1788651246.362443:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.362468:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.362477:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.362518:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651246.362524:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.362753:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.362778:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93be61d23800) 00010000:00010000:2.0:1788651246.362781:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651246.362789:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.362797:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07e00/0x84a2fba88797878c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.378274:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651246.378400:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389458816 00000100:00100000:3.0:1788651246.378413:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389458816 00000100:00100000:3.0:1788651246.378478:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:3.0:1788651246.378489:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+13:14430:x1875536389458816:12345-192.168.203.21@tcp:101:bash.0 00010000:00010000:3.0:1788651246.378518:0:16276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651246.378543:0:16276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba8879787a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c52c expref: -99 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378684:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378700:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378734:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651246.378782:0:16276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788651246.378787:0:16276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651246.378867:0:16276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378880:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378908:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba8879787a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 15 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378929:0:16276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 14 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.378938:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:3.0:1788651246.378942:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651246.378945:0:16276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429ca400, rc 0) 00000100:00100000:3.0:1788651246.379156:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+14:14430:x1875536389458816:12345-192.168.203.21@tcp:101:bash.0 Request processed in 616us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651246.379168:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1788651246.386526:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.386742:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389459072 00000100:00100000:1.0:1788651246.386755:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389459072 00000100:00100000:1.0:1788651246.386860:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1788651246.386873:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+14:14430:x1875536389459072:12345-192.168.203.21@tcp:35:bash.0 00000100:00100000:1.0:1788651246.387412:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+15:14430:x1875536389459072:12345-192.168.203.21@tcp:35:bash.0 Request processed in 537us (897us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788651246.387421:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1788651246.459970:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.460181:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389459328 00000100:00100000:2.0:1788651246.460196:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389459328 00000100:00100000:2.0:1788651246.460323:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:2.0:1788651246.460335:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+15:14440:x1875536389459328:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651246.460376:0:15393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.460403:0:15393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba8879787af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c533 expref: -99 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.460518:0:15393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788651246.460679:0:15393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba8879787af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c533 expref: 17 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.460697:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93be58f79a00) 00010000:00010000:2.0:1788651246.460716:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651246.460724:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba8879787af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c533 expref: 17 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.460742:0:15393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06c00, rc 0) 00000100:00100000:2.0:1788651246.460823:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+16:14440:x1875536389459328:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 490us (867us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788651246.460831:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:2.0:1788651246.470193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651246.470268:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389459584 00000100:00100000:0.0:1788651246.470283:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389459584 00000100:00100000:0.0:1788651246.470359:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1788651246.470371:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+16:14440:x1875536389459584:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:0.0:1788651246.470708:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+17:14440:x1875536389459584:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 337us (527us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788651246.470717:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1788651246.504150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.504710:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389459840 00000100:00100000:2.0:1788651246.504724:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389459840 00000100:00100000:2.0:1788651246.504813:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:2.0:1788651246.504834:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+17:14443:x1875536389459840:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1788651246.504866:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.504894:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba8879787bd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c53a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.505033:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879787c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.505052:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879787c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.505065:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879787c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.505079:0:14402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788651246.505286:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06c00/0x84a2fba8879787bd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c53a expref: 20 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.505331:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879787c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c53a expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.505353:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:2.0:1788651246.505356:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651246.505361:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07a00, rc 0) 00000100:00100000:2.0:1788651246.505460:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:14443:x1875536389459840:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 630us (1361us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788651246.505468:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:3.0:1788651246.513544:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.514529:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389459968 00000100:00100000:1.0:1788651246.514546:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389459968 00000100:00100000:1.0:1788651246.514636:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:1.0:1788651246.514649:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:14443:x1875536389459968:12345-192.168.203.21@tcp:54:lfs.0 00010000:00010000:1.0:1788651246.514741:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.514762:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.514941:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.514989:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.514997:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.515005:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.515011:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618ac00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651246.515016:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.515033:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.515049:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651246.515052:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651246.515058:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.515064:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ac00/0x84a2fba8879787d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.515901:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:14443:x1875536389459968:12345-192.168.203.21@tcp:54:lfs.0 Request processed in 1247us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.515912:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:1.0:1788651246.519054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.520517:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389460096 00000100:00100000:2.0:1788651246.520536:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389460096 00000100:00100000:3.0:1788651246.520624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651246.520708:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1788651246.520726:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:2355:x1875536389460096:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651246.520747:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651246.520779:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07a00/0x84a2fba8879787c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c53a expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.520803:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:0.0:1788651246.520809:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651246.520879:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+18:2355:x1875536389460096:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 158us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651246.520886:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1788651246.521715:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389460352 00000100:00100000:1.0:1788651246.521727:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389460352 00000100:00100000:1.0:1788651246.521771:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1788651246.521780:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+18:14443:x1875536389460352:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:1.0:1788651246.522099:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:14443:x1875536389460352:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 320us (1481us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788651246.522129:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000040:00080000:0.0:1788651246.597438:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788651246.760254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.760398:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389460608 00000100:00100000:2.0:1788651246.760411:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389460608 00000100:00100000:2.0:1788651246.760493:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1788651246.760507:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:14474:x1875536389460608:12345-192.168.203.21@tcp:101:cat.0 00010000:00010000:2.0:1788651246.760542:0:15393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.760571:0:15393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06600/0x84a2fba8879787d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c541 expref: -99 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.760704:0:15393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba8879787e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.760720:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba8879787e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.760735:0:15393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba8879787e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651246.760770:0:15393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788651246.760974:0:15393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06600/0x84a2fba8879787d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c541 expref: 22 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.760998:0:15393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba8879787e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c541 expref: 21 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.761008:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:2.0:1788651246.761011:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651246.761016:0:15393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07c00, rc 0) 00000100:00100000:2.0:1788651246.761100:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:14474:x1875536389460608:12345-192.168.203.21@tcp:101:cat.0 Request processed in 596us (861us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788651246.761184:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:2.0:1788651246.763941:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651246.767854:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651246.768272:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389460992 00000100:00100000:0.0:1788651246.768286:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389460992 00000100:00100000:0.0:1788651246.768385:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:0.0:1788651246.768398:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:2354:x1875536389460992:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651246.768420:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651246.768471:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba8879787e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c541 expref: 21 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651246.768493:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:0.0:1788651246.768499:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651246.768574:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+20:2354:x1875536389460992:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 178us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651246.768582:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:1.0:1788651246.769468:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389460864 00000100:00100000:1.0:1788651246.769479:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389460864 00000100:00100000:1.0:1788651246.769522:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1788651246.769531:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+20:14474:x1875536389460864:12345-192.168.203.21@tcp:35:cat.0 00000100:00100000:1.0:1788651246.770197:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:14474:x1875536389460864:12345-192.168.203.21@tcp:35:cat.0 Request processed in 663us (6266us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788651246.770206:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1788651246.834692:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.834925:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389461248 00000100:00100000:2.0:1788651246.834940:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389461248 00000100:00100000:2.0:1788651246.835032:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1788651246.835045:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:14480:x1875536389461248:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:2.0:1788651246.835077:0:16276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.835102:0:16276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06600/0x84a2fba8879787ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c548 expref: -99 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835267:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835284:0:16276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835306:0:16276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 22 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835315:0:16276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835356:0:16276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 22 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835372:0:16276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 22 pid: 16276 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.835389:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408319104:192.168.203.21@tcp:104: 00010000:00010000:2.0:1788651246.835540:0:16276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 22 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.835550:0:16276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 22 pid: 14402 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.835560:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408319232:192.168.203.21@tcp:104: 00000100:00100000:2.0:1788651246.835587:0:16276:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7555c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788651246.841622:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.841663:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.841829:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389461376 00000100:00100000:1.0:1788651246.841841:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389461376 00010000:00010000:1.0:1788651246.841896:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 23 pid: 16276 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.841937:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389461504 00000100:00100000:1.0:1788651246.841941:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389461504 00010000:00010000:1.0:1788651246.841955:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 24 pid: 14402 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.841984:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651246.841996:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7ba51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:2355:x1875536389461376:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651246.842044:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651246.842052:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 24 pid: 16276 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842067:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 24 pid: 16276 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842094:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651246.842101:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842144:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842152:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651246.842217:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7ba51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:2355:x1875536389461376:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 223us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.842226:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1788651246.842292:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1788651246.842299:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+23:2355:x1875536389461504:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651246.842308:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651246.842314:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 23 pid: 14402 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842324:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 23 pid: 14402 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842347:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651246.842351:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842360:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842368:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.842390:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651246.842411:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+23:2355:x1875536389461504:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 113us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.842418:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00010000:00010000:3.0:1788651246.844239:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba8879787a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c52c expref: 22 pid: 16276 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651246.844269:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408319104:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651246.844285:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978793 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c525 expref: 21 pid: 14402 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651246.844296:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7556a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408319232:192.168.203.21@tcp:104: 00010000:00010000:3.0:1788651246.844325:0:16276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.844347:0:16276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.844354:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651246.844379:0:16276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788651246.844624:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06600/0x84a2fba8879787ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c548 expref: 22 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.844642:0:16276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06400/0x84a2fba8879787f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c548 expref: 21 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.844652:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:3.0:1788651246.844654:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788651246.844659:0:16276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f06400, rc 0) 00000100:00100000:3.0:1788651246.844744:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:14480:x1875536389461248:12345-192.168.203.21@tcp:101:dd.0 Request processed in 9701us (10067us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788651246.844771:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:2.0:1788651246.847196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.847444:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389461760 00000100:00100000:1.0:1788651246.847459:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389461760 00000100:00100000:1.0:1788651246.847618:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:1.0:1788651246.847631:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:14480:x1875536389461760:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:1.0:1788651246.848074:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.848096:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.848150:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651246.848218:0:14403:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788651246.848250:0:14403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049afa327 reply state 0000000053ff396e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651246.848277:0:14403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651246.848758:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14480:x1875536389461760:12345-192.168.203.21@tcp:36:dd.0 Request processed in 1126us (1573us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788651246.848768:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00000020:00080000:1.0:1788651246.848775:0:14403:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788651246.851363:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651246.851445:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389461888 00000100:00100000:2.0:1788651246.851480:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389461888 00000100:00100000:2.0:1788651246.851562:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:2.0:1788651246.851575:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14480:x1875536389461888:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:2.0:1788651246.851607:0:15393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651246.851632:0:15393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07400/0x84a2fba88797880a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c54f expref: -99 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.851708:0:15393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07400/0x84a2fba88797880a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c54f expref: 25 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.851725:0:15393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07400/0x84a2fba88797880a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c54f expref: 25 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651246.851748:0:15393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:2.0:1788651246.851751:0:15393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651246.851755:0:15393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07400, rc 0) 00010000:00010000:1.0:1788651246.851866:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.851875:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.851883:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.851889:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651246.851894:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.851903:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.851916:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651246.851918:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651246.851922:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.851929:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b800/0x84a2fba887978803 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651246.852964:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14480:x1875536389461888:12345-192.168.203.21@tcp:101:dd.0 Request processed in 1381us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651246.852977:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:3.0:1788651246.869052:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.869314:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389462144 00000100:00100000:1.0:1788651246.869345:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389462144 00000100:00100000:1.0:1788651246.869431:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:1.0:1788651246.869443:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14480:x1875536389462144:12345-192.168.203.21@tcp:103:dd.0 00010000:00010000:1.0:1788651246.869464:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651246.869496:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07400/0x84a2fba88797880a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c54f expref: 24 pid: 15393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.869517:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651246.869523:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651246.869824:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+23:14480:x1875536389462144:12345-192.168.203.21@tcp:103:dd.0 Request processed in 381us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.869833:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1788651246.872762:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651246.872954:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389462272 00000100:00100000:3.0:1788651246.872978:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389462272 00000100:00100000:3.0:1788651246.873063:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:3.0:1788651246.873075:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+23:14480:x1875536389462272:12345-192.168.203.21@tcp:58:dd.0 00010000:00010000:3.0:1788651246.873266:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.873288:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651246.873303:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651246.875265:0:16276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651246.875535:0:16276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788651246.875698:0:16276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788651246.876066:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+23:14480:x1875536389462272:12345-192.168.203.21@tcp:58:dd.0 Request processed in 2984us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651246.876080:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:2.0:1788651246.879078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651246.881089:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389462400 00000100:00100000:1.0:1788651246.881174:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389462400 00000100:00100000:1.0:1788651246.881307:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 38 00000100:00100000:1.0:1788651246.881320:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+23:14480:x1875536389462400:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:1.0:1788651246.881422:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651246.881450:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c556 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.881526:0:14403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.881540:0:14403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 24 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.881643:0:14403:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.881684:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 24 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.881701:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651246.881704:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651246.881708:0:14403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 24 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651246.881716:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618ba00, rc 0) 00000100:00100000:1.0:1788651246.881858:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14480:x1875536389462400:12345-192.168.203.21@tcp:101:dd.0 Request processed in 539us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651246.881866:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 38 00010000:00010000:1.0:1788651247.300430:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651247.621735:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788651247.621750:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651247.621800:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788651247.621807:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788651247.621970:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7be74a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14433:1875536408319360:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651247.622165:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1788651247.632772:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651247.632909:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7be74a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14433:1875536408319360:192.168.203.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788651247.633531:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389462528 00000100:00100000:3.0:1788651247.633542:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389462528 00000100:00100000:3.0:1788651247.633629:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1788651247.633641:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389462528:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788651247.633749:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389462528:12345-192.168.203.21@tcp:900:lhsmtool_posix.0 Request processed in 109us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651247.633778:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00080000:2.0:1788651247.636048:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651247.643867:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.643972:0:15393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389462656 00000100:00100000:2.0:1788651247.643986:0:15393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389462656 00000100:00100000:2.0:1788651247.644074:0:15393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:2.0:1788651247.644087:0:15393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389462656:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651247.644173:0:15393:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651247.644343:0:15393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389462656:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 257us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651247.644351:0:15393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 39 00000100:00100000:0.0:1788651247.649311:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651247.649593:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389462784 00000100:00100000:3.0:1788651247.649605:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389462784 00000100:00100000:3.0:1788651247.649796:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:3.0:1788651247.649809:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389462784:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788651247.649909:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.649931:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.650058:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660559:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660584:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660596:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660640:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660649:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660657:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651247.660718:0:16276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788651247.660722:0:16276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788651247.660741:0:16276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660754:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660761:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660767:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660773:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cae00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651247.660778:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660786:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660799:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be58f79f00) 00010000:00010000:3.0:1788651247.660802:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651247.660807:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660814:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cae00/0x84a2fba88797881f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660829:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660846:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660852:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660857:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429ca000 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651247.660860:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660867:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660875:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93be501e3a00) 00010000:00010000:3.0:1788651247.660878:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651247.660881:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660886:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978826 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660901:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660907:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660913:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660917:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cbc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:3.0:1788651247.660925:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660932:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660939:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:3.0:1788651247.660942:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651247.660944:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.660951:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797882d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651247.661048:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389462784:12345-192.168.203.21@tcp:34:lhsmtool_posix.0 Request processed in 11237us (11748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651247.661058:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 40 00000100:00100000:3.0:1788651247.669069:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.670270:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389463040 00000100:00100000:1.0:1788651247.670287:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389463040 00000100:00100000:1.0:1788651247.670377:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1788651247.670389:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+24:14482:x1875536389463040:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651247.670415:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651247.670455:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba887978834 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c55d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.671833:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.671864:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.671898:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651247.671919:0:14403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788651247.673288:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673304:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673312:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673319:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651247.673324:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673333:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673351:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:1.0:1788651247.673355:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788651247.673361:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673368:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797883b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673436:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba887978834 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c55d expref: 26 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673466:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93be58f79f00) 00010000:00010000:1.0:1788651247.673469:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651247.673473:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b200/0x84a2fba887978834 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c55d expref: 26 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.673484:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618b200, rc 0) 00000100:00100000:1.0:1788651247.673588:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+25:14482:x1875536389463040:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 3200us (4528us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788651247.673599:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:1.0:1788651247.682430:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.682532:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389463168 00000100:00100000:2.0:1788651247.682549:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389463168 00000100:00100000:2.0:1788651247.682646:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:2.0:1788651247.682658:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+25:14482:x1875536389463168:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651247.682696:0:14402:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651247.682812:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+25:14482:x1875536389463168:12345-192.168.203.21@tcp:53:lhsmtool_posix.0 Request processed in 156us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651247.682821:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 42 00000100:00100000:0.0:1788651247.693570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651247.693844:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389463424 00000100:00100000:3.0:1788651247.693856:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389463424 00000100:00100000:3.0:1788651247.693923:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1788651247.693934:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+25:14482:x1875536389463424:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651247.693959:0:16276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651247.693984:0:16276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba887978849 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c564 expref: -99 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788651247.694812:0:16276:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788651247.694822:0:16276:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788651247.694887:0:16276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788651247.695277:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978850 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.695304:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.695319:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.695397:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba887978849 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c564 expref: 28 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.695418:0:16276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c564 expref: 27 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.695428:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be501e3a00) 00010000:00010000:3.0:1788651247.695431:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651247.695435:0:16276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be429ca000, rc 0) 00000100:00100000:3.0:1788651247.695527:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+27:14482:x1875536389463424:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 1593us (1967us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788651247.695536:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 43 00000100:00100000:3.0:1788651247.702851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.703102:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389463680 00000100:00100000:1.0:1788651247.703152:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389463680 00000100:00100000:1.0:1788651247.703344:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1788651247.703357:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+27:14482:x1875536389463680:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788651247.703440:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651247.703478:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca000/0x84a2fba887978850 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c564 expref: 27 pid: 16276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.703500:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be501e3a00) 00010000:00010000:1.0:1788651247.703513:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651247.703542:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.703559:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.703591:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706176:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706314:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706330:0:14403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706413:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706421:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706427:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706432:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651247.706436:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706443:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706456:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93be58f79d00) 00010000:00010000:1.0:1788651247.706459:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651247.706463:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706484:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba88797885e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706497:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706503:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706507:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706512:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651247.706514:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706520:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706527:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x197af81b (ffff93be58f79800) 00010000:00010000:1.0:1788651247.706529:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651247.706532:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.706537:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618b400/0x84a2fba887978865 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x197af81b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651247.706642:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+26:14482:x1875536389463680:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 3277us (3796us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788651247.706652:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 44 00000100:00100000:1.0:1788651247.711067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.711231:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389463808 00000100:00100000:2.0:1788651247.711248:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389463808 00000100:00100000:2.0:1788651247.711385:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:2.0:1788651247.711398:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+26:14482:x1875536389463808:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651247.711424:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651247.711455:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba88797886c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c56b expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.711503:0:14401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba887978873 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.711519:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba887978873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.711532:0:14401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba887978873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14401 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.711677:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba88797886c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c56b expref: 28 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.711699:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07c00/0x84a2fba887978873 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c56b expref: 27 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.711709:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:2.0:1788651247.711713:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651247.711716:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07c00, rc 0) 00000100:00100000:2.0:1788651247.711905:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+27:14482:x1875536389463808:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 508us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651247.711913:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:0.0:1788651247.718033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651247.718172:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389464064 00000100:00100000:3.0:1788651247.718189:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389464064 00000100:00100000:3.0:1788651247.718264:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1788651247.718277:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+27:14482:x1875536389464064:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788651247.718398:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.718421:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.718456:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651247.718962:0:16276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788651247.718977:0:16276:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451778867784ns, next at 452778864441ns, rc = 0 00000004:00010000:3.0:1788651247.719104:0:16276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077a024a9 reply state 000000007e86d649 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651247.719172:0:16276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651247.719306:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+29:14482:x1875536389464064:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1289us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788651247.719315:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 46 00000100:00100000:3.0:1788651247.722435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.722569:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389464192 00000100:00100000:1.0:1788651247.722595:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389464192 00000100:00100000:1.0:1788651247.722678:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1788651247.722692:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+29:14482:x1875536389464192:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651247.722723:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651247.722750:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c572 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.722836:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 30 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.722854:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 30 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.722877:0:14403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:1.0:1788651247.722881:0:14403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651247.722886:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618be00, rc 0) 00000100:00100000:1.0:1788651247.722958:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+30:14482:x1875536389464192:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 269us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.722966:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 47 00000100:00100000:1.0:1788651247.725952:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651247.726057:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389464320 00000100:00100000:3.0:1788651247.726070:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389464320 00000100:00100000:3.0:1788651247.726187:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:3.0:1788651247.726199:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2355:x1875536389464320:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788651247.726663:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2355:x1875536389464320:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 464us (723us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788651247.726672:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00010000:00010000:2.0:1788651247.729937:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.729968:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.729976:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.729982:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cbc00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:2.0:1788651247.729987:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.729996:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.730025:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:2.0:1788651247.730049:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788651247.730056:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.730063:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cbc00/0x84a2fba88797887a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651247.730445:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.730601:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389464576 00000100:00100000:1.0:1788651247.730614:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389464576 00000100:00100000:1.0:1788651247.730690:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1788651247.730703:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+29:14482:x1875536389464576:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788651247.731882:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+30:14482:x1875536389464576:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 1173us (1435us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788651247.731912:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1788651247.735543:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.735939:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389464832 00000100:00100000:2.0:1788651247.735953:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389464832 00000100:00100000:2.0:1788651247.736040:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:2.0:1788651247.736054:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+30:14482:x1875536389464832:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788651247.736527:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+30:14482:x1875536389464832:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 472us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651247.736537:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 48 00000100:00100000:0.0:1788651247.744290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.744437:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389464960 00000100:00100000:2.0:1788651247.744450:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389464960 00000100:00100000:2.0:1788651247.744525:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:2.0:1788651247.744538:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+30:14482:x1875536389464960:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651247.744565:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651247.744596:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978888 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c579 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.744709:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07800/0x84a2fba88797888f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.744727:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07800/0x84a2fba88797888f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.744741:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07800/0x84a2fba88797888f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651247.744790:0:14402:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788651247.744994:0:14402:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07800/0x84a2fba88797888f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.745048:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f06200/0x84a2fba887978888 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c579 expref: 32 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.745071:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07800/0x84a2fba88797888f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c579 expref: 31 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.745081:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:2.0:1788651247.745084:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788651247.745088:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93bd42f07800, rc 0) 00000100:00100000:0.0:1788651247.745415:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+31:14482:x1875536389464960:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 869us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651247.745434:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:3.0:1788651247.748824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.748991:0:16629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389465088 00000100:00100000:1.0:1788651247.749006:0:16629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389465088 00000100:00100000:1.0:1788651247.749090:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1788651247.749102:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+6:2355:x1875536389465088:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651247.749163:0:16629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651247.749193:0:16629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c580 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651247.749228:0:16629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca6f0, blocks: 0x1 00010000:00010000:1.0:1788651247.749254:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788651247.749259:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651247.749271:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 7 pid: 16629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.749295:0:16629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 7 pid: 16629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.749310:0:16629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be4618a400, rc 0) 00000100:00100000:1.0:1788651247.749398:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2355:x1875536389465088:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 298us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.749533:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1788651247.763673:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.763871:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389465344 00000100:00100000:1.0:1788651247.763884:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389465344 00000100:00100000:1.0:1788651247.763957:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:1.0:1788651247.763987:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+31:14482:x1875536389465344:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788651247.764184:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+31:14482:x1875536389465344:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 198us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.764192:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 50 00000100:00100000:2.0:1788651247.773089:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651247.773517:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389465472 00000100:00100000:0.0:1788651247.773532:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389465472 00000100:00100000:0.0:1788651247.774369:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:0.0:1788651247.774383:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+31:14482:x1875536389465472:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788651247.860524:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:1.0:1788651247.860545:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1788651247.860654:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788651247.860707:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788651247.860816:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+16:14482:x1875536389465472:12345-192.168.203.21@tcp:44:lhsmtool_posix.0 Request processed in 86424us (87732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651247.860842:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 51 00000100:00100000:2.0:1788651247.861348:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651247.861369:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408319488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788651247.861512:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651247.861685:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408319488 00000100:00100000:3.0:1788651247.861696:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408319488 00000100:00100000:3.0:1788651247.861810:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788651247.861821:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875536408319488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788651247.862063:0:15084:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788651247.862067:0:15084:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788651247.862070:0:15084:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788651247.862072:0:15084:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788651248 -> 1788651248 00002000:00010000:3.0:1788651247.862075:0:15084:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788651247.862661:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875536408319488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 839us (1146us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788651247.862670:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788651247.862731:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93be7540f100/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788651247.862738:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875536408319488:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788651247.867226:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651247.868546:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651247.868747:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389465600 00000100:00100000:3.0:1788651247.868760:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389465600 00000100:00100000:3.0:1788651247.868821:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:3.0:1788651247.868833:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2356:x1875536389465600:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788651247.869021:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2356:x1875536389465600:12345-192.168.203.21@tcp:16:lhsmtool_posix.0 Request processed in 182us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651247.869029:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:1.0:1788651247.874884:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651247.874992:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389465856 00000100:00100000:0.0:1788651247.875019:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389465856 00000100:00100000:0.0:1788651247.875220:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 52 00000100:00100000:0.0:1788651247.875238:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+14:14482:x1875536389465856:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651247.875311:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651247.875348:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93bd42f07800/0x84a2fba88797888f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c579 expref: 14 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.875374:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:0.0:1788651247.875380:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651247.875423:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.875440:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.875452:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651247.875709:0:14402:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edbc1273 reply state 00000000e2427646 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651247.875739:0:14402:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651247.875887:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+15:14482:x1875536389465856:12345-192.168.203.21@tcp:36:lhsmtool_posix.0 Request processed in 653us (1010us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788651247.875895:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 52 00010000:00010000:1.0:1788651247.878429:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.878446:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.878454:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.878469:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860e00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:1.0:1788651247.878475:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.878484:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.878504:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:1.0:1788651247.878507:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651247.878512:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.878518:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860e00/0x84a2fba88797889d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14402 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651247.879696:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651247.880462:0:15803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389465984 00000100:00100000:0.0:1788651247.880481:0:15803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389465984 00000100:00100000:0.0:1788651247.880565:0:15803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:0.0:1788651247.880580:0:15803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:14482:x1875536389465984:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651247.880603:0:15803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651247.880626:0:15803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x486af2b811a7c587 expref: -99 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.880739:0:15803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.880750:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651247.880755:0:15803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651247.880761:0:15803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 8 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.880806:0:15803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.880823:0:15803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651247.880861:0:15803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15803:1875536408319616:192.168.203.21@tcp:104: 00000100:00100000:0.0:1788651247.880972:0:15803:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651247.890448:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.892969:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389466112 00000100:00100000:2.0:1788651247.892984:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389466112 00000100:00100000:0.0:1788651247.895669:0:15803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15803:1875536408319616:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651247.895892:0:15803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 9 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.895922:0:15803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93be75861200, rc 0) 00000100:00100000:0.0:1788651247.896025:0:15803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:14482:x1875536389465984:12345-192.168.203.21@tcp:101:lhsmtool_posix.0 Request processed in 15438us (16324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651247.896036:0:15803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:3.0:1788651247.897789:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651247.897846:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:3.0:1788651247.897856:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+8:2355:x1875536389466112:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651247.897872:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651247.897898:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.897929:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.897961:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443c0b09/0x84a2fba887978896 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c580 expref: 8 pid: 16629 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.897977:0:14387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651247.897982:0:14387:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651247.897988:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 7 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.897998:0:14387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 7 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.898047:0:14387:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 7 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651247.898062:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14387:1875536408319744:192.168.203.21@tcp:105: 00000100:00100000:3.0:1788651247.898318:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be597116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651247.905205:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14387:1875536408319744:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651247.905246:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651247.905309:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2355:x1875536389466112:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 7454us (14869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651247.905322:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1788651247.912868:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.913836:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389466240 00000100:00100000:1.0:1788651247.913852:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389466240 00000100:00100000:1.0:1788651247.914147:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651247.914162:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be750ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2356:x1875536389466240:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788651247.915854:0:15083:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788651247.915864:0:15083:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788651247 00002000:00010000:1.0:1788651247.915869:0:15083:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788651246 00002000:00010000:1.0:1788651247.915872:0:15083:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788651248 -> 1788651247 00002000:00010000:1.0:1788651247.915874:0:15083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788651247.915979:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be750ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+8:2356:x1875536389466240:12345-192.168.203.21@tcp:2:lhsmtool_posix.0 Request processed in 1816us (3119us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788651247.915992:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:1.0:1788651247.922840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651247.922990:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389466368 00000100:00100000:3.0:1788651247.923004:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389466368 00000100:00100000:3.0:1788651247.923087:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1788651247.923099:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be45a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+8:2353:x1875536389466368:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788651247.923210:0:15085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.923253:0:15085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 8 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.923264:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651247.923269:0:15085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651247.923275:0:15085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.923324:0:15085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 8 pid: 15803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.923342:0:15085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 8 pid: 15803 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651247.923361:0:15085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15085:1875536408319872:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651247.923456:0:15085:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be597116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651247.931908:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.932023:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389466496 00000100:00100000:2.0:1788651247.932045:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389466496 00010000:00010000:2.0:1788651247.932148:0:14386:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 9 pid: 15803 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651247.932187:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:2.0:1788651247.932198:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:2355:x1875536389466496:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651247.932228:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651247.932250:0:14386:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 9 pid: 15803 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.932265:0:14386:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 9 pid: 15803 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.932290:0:14386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651247.932295:0:14386:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651247.932301:0:14386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.932310:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.932330:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651247.932405:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:2355:x1875536389466496:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 209us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651247.932413:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00010000:00010000:1.0:1788651247.932516:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a3cf51/0x84a2fba8879788a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c587 expref: 8 pid: 15803 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651247.932542:0:15085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15085:1875536408319872:192.168.203.21@tcp:104: 00010000:00010000:1.0:1788651247.932571:0:15085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932585:0:15085:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932615:0:15085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932667:0:15085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932677:0:15085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932686:0:15085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932707:0:15085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cae00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651247.932713:0:15085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932724:0:15085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932741:0:15085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.932751:0:15085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eabfe2f/0x84a2fba8879788ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651247.932848:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be45a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2353:x1875536389466368:12345-192.168.203.21@tcp:1:lhsmtool_posix.0 Request processed in 9750us (10023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.932859:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1788651247.937081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1788651247.937215:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389466752 00000100:00100000:2.0:1788651247.937231:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389466752 00000100:00100000:3.0:1788651247.937629:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:3.0:1788651247.937643:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+14:14482:x1875536389466752:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788651247.937747:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.937768:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.937809:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.938785:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.939196:0:16276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 15 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.939209:0:16276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.939263:0:16276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 15 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651247.939285:0:16276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 15 pid: 14403 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651247.939305:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7540ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408320000:192.168.203.21@tcp:104: 00000100:00100000:3.0:1788651247.939654:0:16276:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be597116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651247.947049:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651247.947190:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7540ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408320000:192.168.203.21@tcp:104: 00010000:00010000:0.0:1788651247.947227:0:16276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651247.947313:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389466880 00000100:00100000:1.0:1788651247.947323:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389466880 00010000:00010000:1.0:1788651247.947372:0:14387:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 16 pid: 14403 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651247.947410:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:1.0:1788651247.947421:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+16:2356:x1875536389466880:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651247.947441:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651247.947450:0:14387:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 16 pid: 14403 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.947464:0:14387:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 16 pid: 14403 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.947492:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618be00/0x84a2fba887978881 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c572 expref: 16 pid: 14403 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.947509:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:1.0:1788651247.947514:0:14387:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.947526:0:14387:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.947554:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651247.947586:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651247.947644:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+15:2356:x1875536389466880:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 224us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.947651:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:0.0:1788651247.947721:0:16276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.947729:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651247.947978:0:16276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788651247.948203:0:16276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788651247.948251:0:16276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788651247.948354:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe70700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16276:1875536408320128:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788651247.951542:0:16276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651247.951601:0:16276:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be7bb07e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651247.951637:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408320128 00000100:00100000:1.0:1788651247.951654:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408320128 00000100:00100000:1.0:1788651247.951744:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651247.951758:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16276:x1875536408320128:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788651247.951927:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16276:x1875536408320128:12345-0@lo:1000:mdt00_004.0 Request processed in 172us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.951936:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651247.952034:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe70700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16276:1875536408320128:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788651247.956974:0:16276:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788651247.957082:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe70700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16276:1875536408320256:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788651247.957190:0:16276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651247.957242:0:16276:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488adc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651247.957281:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408320256 00000100:00100000:2.0:1788651247.957296:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408320256 00000100:00100000:2.0:1788651247.957385:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788651247.957397:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16276:x1875536408320256:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788651247.957688:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16276:x1875536408320256:12345-0@lo:1000:mdt00_004.0 Request processed in 292us (497us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788651247.958301:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe70700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:16276:1875536408320256:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788651247.958342:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958352:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958359:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958365:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429caa00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651247.958370:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958378:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958411:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:0.0:1788651247.958414:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651247.958420:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958426:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429caa00/0x84a2fba8879788b9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958459:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958465:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958471:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958477:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429ca400 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651247.958479:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958485:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958493:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:0.0:1788651247.958496:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651247.958502:0:16276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958513:0:16276:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958529:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.958586:0:16276:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93be4618ba00/0x84a2fba887978818 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0x486af2b811a7c556 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651247.958600:0:16276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe73480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408320384:192.168.203.21@tcp:105: 00000100:00100000:0.0:1788651247.958681:0:16276:0:(client.c:2716:ptlrpc_set_wait()) set ffff93be488adc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651247.958689:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651247.965398:0:16276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe73480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16276:1875536408320384:192.168.203.21@tcp:105: 00010000:00010000:0.0:1788651247.965431:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965455:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429ca400/0x84a2fba887978811 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965495:0:16276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965510:0:16276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965522:0:16276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965533:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965540:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965564:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965570:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861a00 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651247.965573:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965581:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965593:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:0.0:1788651247.965596:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651247.965600:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965606:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75861a00/0x84a2fba8879788c0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965617:0:16276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965623:0:16276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965630:0:16276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965635:0:16276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be429cb200 already unused, calling callback (ffffffffc21554f0) 00010000:00010000:0.0:1788651247.965638:0:16276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965654:0:16276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965664:0:16276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93be61d23e00) 00010000:00010000:0.0:1788651247.965666:0:16276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651247.965670:0:16276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.965675:0:16276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be429cb200/0x84a2fba8879788b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651247.965922:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+18:14482:x1875536389466752:12345-192.168.203.21@tcp:57:lhsmtool_posix.0 Request processed in 28281us (28852us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788651247.965933:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00000020:00080000:0.0:1788651247.965939:0:16276:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788651247.966215:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788651247.966220:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651247.966262:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788651247.966268:0:14433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788651247.969405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651247.969961:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467008 00000100:00100000:1.0:1788651247.969971:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467008 00000100:00100000:1.0:1788651247.970046:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1788651247.970057:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be46137450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+18:14480:x1875536389467008:12345-192.168.203.21@tcp:49:dd.0 00000100:00100000:1.0:1788651247.970319:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be46137450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+18:14480:x1875536389467008:12345-192.168.203.21@tcp:49:dd.0 Request processed in 263us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651247.970326:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1788651247.987262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651247.987316:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467264 00000100:00100000:0.0:1788651247.987326:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467264 00000100:00100000:0.0:1788651247.987383:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1788651247.987393:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+18:14482:x1875536389467264:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788651247.988073:0:14404:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788651247.989491:0:14404:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788651247.989557:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.989575:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.989598:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.989607:0:14404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.989613:0:14404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.989619:0:14404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651247.989636:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651247.989846:0:14390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651247.989854:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.989861:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75860a00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651247.989865:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.989873:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.989886:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93be61d23800) 00010000:00010000:2.0:1788651247.989889:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788651247.989893:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.989899:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93be75860a00/0x84a2fba8879788c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651247.989913:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651247.989914:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651247.989916:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651247.991165:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+20:14482:x1875536389467264:12345-192.168.203.21@tcp:35:lhsmtool_posix.0 Request processed in 3688us (3826us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788651247.991180:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000020:00080000:0.0:1788651247.991187:0:14404:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788651248.166602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651248.166724:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467392 00000100:00100000:1.0:1788651248.166754:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467392 00000100:00100000:1.0:1788651248.166893:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:1.0:1788651248.166905:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7556bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2356:x1875536389467392:12345-192.168.203.21@tcp:4:dd.0 00002000:00010000:1.0:1788651248.166955:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ca6ef, atime: 0x6a9ca6ee, ctime: 0x6a9ca6ef, blocks: 0x1 00010000:00010000:1.0:1788651248.166965:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.166980:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788651248.166985:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.166992:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.167008:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651248.167233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00080000:2.0:1788651248.167567:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651248.173704:0:15089:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788651248.173783:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788651248.174502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651248.174834:0:15089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788651248.175083:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467520 00000100:00100000:0.0:1788651248.175103:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467520 00000100:00100000:2.0:1788651248.176846:0:16632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:2.0:1788651248.176865:0:16632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:2356:x1875536389467520:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:2.0:1788651248.176900:0:16632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.176931:0:16632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651248.176936:0:16632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651248.176942:0:16632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.176955:0:16632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651248.177614:0:15089:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788651248.177634:0:15089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788651248.178381:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467648 00000100:00100000:1.0:1788651248.178394:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467648 00000100:00100000:0.0:1788651248.179803:0:16633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1788651248.179836:0:16633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7540fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+11:2355:x1875536389467648:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:0.0:1788651248.179887:0:16633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.179922:0:16633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651248.179935:0:16633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651248.179944:0:16633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.179961:0:16633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651248.254217:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1788651248.254238:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788651248.254244:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1788651248.254765:0:16632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788651248.254771:0:16632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788651247 -> 1788651248 00002000:00010000:2.0:1788651248.254774:0:16632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1788651248.254787:0:16632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.254809:0:16632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.254819:0:16632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.254827:0:16632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93bd42f07000 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651248.254832:0:16632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.254841:0:16632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.254874:0:16632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.254882:0:16632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edeea42/0x84a2fba8879788d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651248.254959:0:16632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+11:2356:x1875536389467520:12345-192.168.203.21@tcp:4:dd.0 Request processed in 78096us (87732us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788651248.254967:0:16632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00010000:00010000:1.0:1788651248.256140:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.256156:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.256165:0:15088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.256172:0:15088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651248.256187:0:15088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.256205:0:15088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.256222:0:15088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.256230:0:15088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651248.256295:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7556bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:2356:x1875536389467392:12345-192.168.203.21@tcp:4:dd.0 Request processed in 89389us (89698us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788651248.256374:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00002000:00010000:2.0:1788651248.294265:0:16633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1788651248.294287:0:16633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.294372:0:16633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.294381:0:16633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.294388:0:16633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861a00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:2.0:1788651248.294392:0:16633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.294402:0:16633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.294442:0:16633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651248.294449:0:16633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adf2c2a/0x84a2fba8879788dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651248.294549:0:16633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7540fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2355:x1875536389467648:12345-192.168.203.21@tcp:4:dd.0 Request processed in 114717us (120053us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788651248.294560:0:16633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000001:00080000:1.0:1788651248.295948:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:2.0:1788651248.310596:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651248.310961:0:15089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467776 00000100:00100000:1.0:1788651248.310976:0:15089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467776 00000100:00100000:1.0:1788651248.311076:0:15089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1788651248.311089:0:15089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2356:x1875536389467776:12345-192.168.203.21@tcp:4:dd.0 00002000:00010000:1.0:1788651248.311345:0:15089:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9ca6f0, atime: 0x6a9ca6ee, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788651248.311355:0:15089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.311371:0:15089:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788651248.311375:0:15089:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.311382:0:15089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.311411:0:15089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651248.313819:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1788651248.313882:0:16632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389467904 00000100:00100000:0.0:1788651248.313891:0:16632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389467904 00000100:00100000:0.0:1788651248.313956:0:16632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1788651248.313967:0:16632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2356:x1875536389467904:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:0.0:1788651248.313999:0:16632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.314024:0:16632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651248.314029:0:16632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651248.314035:0:16632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.314049:0:16632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651248.315053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651248.315731:0:16633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389468032 00000100:00100000:1.0:1788651248.315740:0:16633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389468032 00000100:00100000:1.0:1788651248.315797:0:16633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1788651248.315807:0:16633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+9:2355:x1875536389468032:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:1.0:1788651248.315834:0:16633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.315849:0:16633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.315853:0:16633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.315860:0:16633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.315874:0:16633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651248.318208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1788651248.318284:0:15088:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788651248.318296:0:15088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1788651248.318934:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389468160 00000100:00100000:0.0:1788651248.318944:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389468160 00000100:00100000:1.0:1788651248.320360:0:16635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:1.0:1788651248.320378:0:16635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be6d517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3263d5cc-8db6-4bb2-9e12-fc97a2814380+11:2355:x1875536389468160:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:1.0:1788651248.320434:0:16635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.320464:0:16635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.320468:0:16635:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.320476:0:16635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.320490:0:16635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651248.329507:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1788651248.332162:0:15088:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:3.0:1788651248.332180:0:15088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00010000:00010000:3.0:1788651248.332209:0:14389:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651248.341155:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536389468288 00000100:00100000:0.0:1788651248.341174:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536389468288 00000100:00100000:1.0:1788651248.348603:0:16636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1788651248.348629:0:16636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3263d5cc-8db6-4bb2-9e12-fc97a2814380+15:2355:x1875536389468288:12345-192.168.203.21@tcp:4:dd.0 00010000:00010000:1.0:1788651248.348683:0:16636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.348705:0:16636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.348710:0:16636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651248.348718:0:16636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.348736:0:16636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651248.420344:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788651248.421916:0:15089:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:0.0:1788651248.421924:0:15089:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788651248 00002000:00010000:0.0:1788651248.421926:0:15089:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788651248.421941:0:15089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.421954:0:15089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.421963:0:15089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.421969:0:15089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618be00 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651248.421974:0:15089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.421983:0:15089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.422003:0:15089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.422021:0:15089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dfc04e/0x84a2fba8879788e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651248.422147:0:15089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3263d5cc-8db6-4bb2-9e12-fc97a2814380+21:2356:x1875536389467776:12345-192.168.203.21@tcp:4:dd.0 Request processed in 111017us (111520us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788651248.422171:0:15089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00010000:1.0:1788651248.468089:0:16632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 16391 00010000:00010000:1.0:1788651248.468139:0:16632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468167:0:16632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468176:0:16632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468183:0:16632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be75861600 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651248.468187:0:16632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468196:0:16632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468214:0:16632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468222:0:16632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d877139/0x84a2fba8879788ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651248.468303:0:16632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3263d5cc-8db6-4bb2-9e12-fc97a2814380+19:2356:x1875536389467904:12345-192.168.203.21@tcp:4:dd.0 Request processed in 154333us (154487us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788651248.468313:0:16632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00010000:00010000:1.0:1788651248.468359:0:16635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468379:0:16635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468386:0:16635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468392:0:16635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b200 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:1.0:1788651248.468395:0:16635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468402:0:16635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468413:0:16635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651248.468420:0:16635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e070bdd4/0x84a2fba8879788f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651248.468455:0:16635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be6d517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3263d5cc-8db6-4bb2-9e12-fc97a2814380+17:2355:x1875536389468160:12345-192.168.203.21@tcp:4:dd.0 Request processed in 148084us (150254us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788651248.468462:0:16635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000001:00080000:1.0:1788651248.468484:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1788651248.468496:0:6698:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1788651248.468775:0:16636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468785:0:16636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468791:0:16636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468810:0:16636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b800 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651248.468813:0:16636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468820:0:16636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468832:0:16636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468839:0:16636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394244df/0x84a2fba8879788ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651248.468874:0:16636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7be75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:3263d5cc-8db6-4bb2-9e12-fc97a2814380+7:2355:x1875536389468288:12345-192.168.203.21@tcp:4:dd.0 Request processed in 120256us (139375us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788651248.468882:0:16636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00010000:00010000:0.0:1788651248.468927:0:16633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468935:0:16633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468942:0:16633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468948:0:16633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93be4618b400 already unused, calling callback (ffffffffc17114f0) 00010000:00010000:0.0:1788651248.468952:0:16633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468959:0:16633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468970:0:16633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651248.468976:0:16633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f510fff/0x84a2fba8879788f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651248.469024:0:16633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3263d5cc-8db6-4bb2-9e12-fc97a2814380+5:2355:x1875536389468032:12345-192.168.203.21@tcp:4:dd.0 Request processed in 153218us (153973us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788651248.469031:0:16633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00010000:00010000:1.0:1788651249.352293:0:16123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788651249.899544:0:16673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788651250.375571:0:14390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651250.564242:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651250.564263:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651250.564332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651250.564398:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408320512 00000100:00100000:1.0:1788651250.564406:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408320512 00000100:00100000:1.0:1788651250.564472:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651250.564482:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408320512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788651250.564486:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788651250.564515:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788651250.564570:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7bb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875536408320512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651250.564577:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788651250.564644:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788651250.564652:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93be7540f100, transno 8589934595 00000004:00080000:2.0:1788651250.564661:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788651250.564694:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be750eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875536408320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651250.564717:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7fe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408320640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651250.564749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651250.564834:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408320640 00000100:00100000:2.0:1788651250.564839:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408320640 00000100:00100000:2.0:1788651250.564883:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788651250.564890:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408320640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651250.564910:0:15086:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788651250.564943:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875536408320640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651250.564958:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788651250.565464:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651250.565506:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7fe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875536408320640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651250.570492:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408321024:0@lo:400:kworker.0 00000100:00100000:1.0:1788651250.570559:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651250.570601:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651250.571721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408321152:0@lo:400:kworker.0 00000100:00100000:0.0:1788651250.571765:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651250.571793:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651250.571798:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3308:1875536408320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788651250.571825:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651250.571877:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408321024 00000100:00100000:0.0:1788651250.571884:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408321024 00000100:00100000:0.0:1788651250.571928:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408321152 00000100:00100000:0.0:1788651250.571931:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408321152 00000100:00100000:0.0:1788651250.571952:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788651250.571960:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408321024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651250.572017:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875536408321024:12345-0@lo:400:kworker.0 Request processed in 57us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651250.572024:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788651250.572039:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788651250.572046:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408321152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651250.572074:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875536408321152:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651250.572080:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788651250.572098:0:14397:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651250.572143:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875536408321152:0@lo:400:kworker.0 00000100:00100000:1.0:1788651250.572234:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93be74f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408320896:0@lo:400:kworker.0 00000100:00100000:1.0:1788651250.572262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651250.572291:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875536408321024:0@lo:400:kworker.0 00000100:00100000:2.0:1788651250.572407:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408320768 00000100:00100000:2.0:1788651250.572413:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408320768 00000100:00100000:2.0:1788651250.572443:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788651250.572451:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3308:x1875536408320768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651250.572494:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0+19:3308:x1875536408320768:12345-0@lo:400:kworker.0 Request processed in 43us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651250.572501:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788651250.573296:0:16276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875536408320896 00000100:00100000:0.0:1788651250.573303:0:16276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875536408320896 00000100:00100000:0.0:1788651250.573373:0:16276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788651250.573381:0:16276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93be75406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651250.573434:0:16276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93be75406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875536408320896:12345-0@lo:400:kworker.0 Request processed in 54us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651250.573441:0:16276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788651250.573596:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be74f97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875536408320896:0@lo:400:kworker.0 00000100:00100000:1.0:1788651250.574827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93be7bb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f0bf4456-1aa6-4ee7-a86e-1f64e5cad8f0:3308:1875536408320768:0@lo:400:kworker.0 Debug log: 29067 lines, 29067 kept, 0 dropped, 0 bad.